[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:02 dist-test-slave-njxd krb5kdc[8404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:02 dist-test-slave-njxd krb5kdc[8404](info): set up 2 sockets
Aug 09 07:58:02 dist-test-slave-njxd krb5kdc[8404](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 07:58:03.080770 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:03.200381 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38699
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:03.319165 8417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:03.319516 8417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:03.319594 8417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:03.323719 8417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:03.323810 8417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:03.323849 8417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:03.323905 8417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:03.323944 8417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:03.329448 8417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:03.330814 8417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:03.331951 8417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:03.341676 8423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:03.341684 8422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:03.341688 8425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:03.341741 8417 server_base.cc:1034] running on GCE node
I20260809 07:58:03.342516 8417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:03.343763 8417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:03.344933 8417 hybrid_clock.cc:648] HybridClock initialized: now 1786262283344910 us; error 33 us; skew 500 ppm
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:03.351981 8417 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:03.352993 8417 webserver.cc:460] Webserver started at http://127.8.51.126:39745/ using document root <none> and password file <none>
I20260809 07:58:03.353669 8417 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:03.353765 8417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:03.354121 8417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:03.356355 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "ec3b6111dc6f417da50877a2e5d31d73"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "d4ac2ecc6e4b4be53dded3e11c959716"
server_key_iv: "402a578ea21efca091889a06676e998c"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.357038 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "ec3b6111dc6f417da50877a2e5d31d73"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "d4ac2ecc6e4b4be53dded3e11c959716"
server_key_iv: "402a578ea21efca091889a06676e998c"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.360970 8417 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 07:58:03.363425 8433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.364691 8417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:03.364832 8417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "ec3b6111dc6f417da50877a2e5d31d73"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "d4ac2ecc6e4b4be53dded3e11c959716"
server_key_iv: "402a578ea21efca091889a06676e998c"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.364944 8417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:03.378659 8417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:03.382138 8417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:03.382364 8417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:03.389528 8417 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38699
I20260809 07:58:03.389557 8488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38699 every 8 connection(s)
I20260809 07:58:03.390560 8417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:03.393462 8489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:03.396307 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 8417
I20260809 07:58:03.396472 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:03.397766 8397 external_mini_cluster.cc:1428] Setting key fe8604e6446161cf17f4f9cb36bfbd3c
I20260809 07:58:03.399276 8489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73: Bootstrap starting.
I20260809 07:58:03.401804 8489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:03.402715 8489 log.cc:824] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:03.405129 8489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73: No bootstrap required, opened a new log
I20260809 07:58:03.410247 8489 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } }
I20260809 07:58:03.410567 8489 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:03.410629 8489 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3b6111dc6f417da50877a2e5d31d73, State: Initialized, Role: FOLLOWER
I20260809 07:58:03.411124 8489 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } }
I20260809 07:58:03.411298 8489 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:03.411407 8489 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:03.411540 8489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:03.412400 8489 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } }
I20260809 07:58:03.412791 8489 leader_election.cc:302] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec3b6111dc6f417da50877a2e5d31d73; no voters:
I20260809 07:58:03.413117 8489 leader_election.cc:288] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:03.413239 8494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:03.413465 8494 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [term 1 LEADER]: Becoming Leader. State: Replica: ec3b6111dc6f417da50877a2e5d31d73, State: Running, Role: LEADER
I20260809 07:58:03.413806 8494 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } }
I20260809 07:58:03.414402 8489 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:03.415745 8495 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec3b6111dc6f417da50877a2e5d31d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } } }
I20260809 07:58:03.415885 8495 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:03.416086 8496 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec3b6111dc6f417da50877a2e5d31d73. Latest consensus state: current_term: 1 leader_uuid: "ec3b6111dc6f417da50877a2e5d31d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6111dc6f417da50877a2e5d31d73" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38699 } } }
I20260809 07:58:03.416285 8496 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:03.417517 8502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:03.420743 8502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:03.426565 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:03.401103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52828 (local address 127.8.51.126:38699)
0809 07:58:03.401632 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:03.401653 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:03.402753 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 07:58:03.407527 (+ 4774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:03.407544 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:03.407849 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:03.408110 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:03.411356 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.412553 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.414269 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.415047 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.415235 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:03.420158 (+ 4923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:03.420163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:03.420176 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:03.420203 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:03.422089 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.422643 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.422649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.422653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.422816 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.423276 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.423280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.423281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.423844 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:03.424033 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:03.424734 (+ 701us) server_negotiation.cc:299] Negotiation successful
0809 07:58:03.424984 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":133,"threads_started":1}
I20260809 07:58:03.427544 8502 catalog_manager.cc:1347] Generated new cluster ID: 5426a3fc36554928823b75c3dd4e17b1
I20260809 07:58:03.427631 8502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:03.436004 8502 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:03.437136 8502 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:03.445149 8502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec3b6111dc6f417da50877a2e5d31d73: Generated new TSK 0
I20260809 07:58:03.445998 8502 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:03.478848 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:03.591233 8516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:03.591470 8516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:03.591511 8516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:03.595544 8516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:03.595595 8516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:03.595702 8516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:03.600677 8516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:03.601689 8516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:03.602658 8516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:03.612248 8522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:03.612247 8525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:03.612360 8516 server_base.cc:1034] running on GCE node
W20260809 07:58:03.612260 8523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:03.612946 8516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:03.613487 8516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:03.614647 8516 hybrid_clock.cc:648] HybridClock initialized: now 1786262283614619 us; error 41 us; skew 500 ppm
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:03.617522 8516 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:03.618314 8516 webserver.cc:460] Webserver started at http://127.8.51.65:42425/ using document root <none> and password file <none>
I20260809 07:58:03.618835 8516 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:03.618932 8516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:03.619133 8516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:03.621057 8516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "7ac617a5f147457b94af1bb562df31f9"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "b1835cabd8876755c4982683bd2b8ba9"
server_key_iv: "399f0f5975bf130e18576fba8b69d207"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.621649 8516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "7ac617a5f147457b94af1bb562df31f9"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "b1835cabd8876755c4982683bd2b8ba9"
server_key_iv: "399f0f5975bf130e18576fba8b69d207"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.625180 8516 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 07:58:03.627523 8533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.628612 8516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:03.628741 8516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "7ac617a5f147457b94af1bb562df31f9"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "b1835cabd8876755c4982683bd2b8ba9"
server_key_iv: "399f0f5975bf130e18576fba8b69d207"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.628850 8516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:03.647658 8516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:03.650556 8516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:03.650765 8516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:03.651360 8516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:03.652205 8516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:03.652274 8516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.652346 8516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:03.652400 8516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.661477 8516 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:42003
I20260809 07:58:03.661504 8654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:42003 every 8 connection(s)
I20260809 07:58:03.662416 8516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:03.665405 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 8516
I20260809 07:58:03.665515 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:03.665822 8397 external_mini_cluster.cc:1428] Setting key 9ba97681f2ad4d7feeb20ca99701a183
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:03.678097 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:03.664352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:54793 (local address 127.8.51.126:38699)
0809 07:58:03.664512 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:03.664517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:03.665401 (+ 884us) server_negotiation.cc:407] Connection header received
0809 07:58:03.667455 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:03.667459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:03.667511 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:03.667601 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:03.668838 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.669761 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.671447 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.671691 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.671809 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:03.674351 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:03.674354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:03.674356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:03.674380 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:03.675881 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.676421 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.676425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.676427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.676524 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.676871 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.676874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.676876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.677073 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:03.677191 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:03.677781 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 07:58:03.677912 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:03.678984 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:03.664796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38699 (local address 127.8.51.65:54793)
0809 07:58:03.665249 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:03.665292 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:03.667180 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:03.667777 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:03.667784 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:03.668197 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:03.668698 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:03.668712 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.669891 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.669896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:03.671318 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:03.671329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.671852 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.671856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:03.672027 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:03.672656 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:03.672673 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:03.674175 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:03.676004 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:03.676010 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:03.676026 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:03.676288 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:03.676628 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:03.676631 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:03.676633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:03.676770 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:03.677191 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:03.677200 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:03.677487 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 07:58:03.677739 (+ 252us) client_negotiation.cc:240] Negotiation successful
0809 07:58:03.678063 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":113,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:03.680341 8655 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38699
I20260809 07:58:03.680603 8655 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:03.681196 8655 heartbeater.cc:511] Master 127.8.51.126:38699 requested a full tablet report, sending...
I20260809 07:58:03.682888 8452 ts_manager.cc:194] Registered new tserver with Master: 7ac617a5f147457b94af1bb562df31f9 (127.8.51.65:42003)
I20260809 07:58:03.684065 8452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:54793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:03.694628 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:03.823347 8660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:03.823597 8660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:03.823642 8660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:03.827666 8660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:03.827718 8660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:03.827772 8660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:03.832962 8660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:03.833958 8660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:03.834942 8660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:03.844283 8668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:03.844312 8666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:03.844283 8665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:03.844558 8660 server_base.cc:1034] running on GCE node
I20260809 07:58:03.845072 8660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:03.845785 8660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:03.846980 8660 hybrid_clock.cc:648] HybridClock initialized: now 1786262283846960 us; error 30 us; skew 500 ppm
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:03.849852 8660 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:03.850661 8660 webserver.cc:460] Webserver started at http://127.8.51.66:36499/ using document root <none> and password file <none>
I20260809 07:58:03.851197 8660 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:03.851253 8660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:03.851419 8660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:03.853415 8660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "38643032ef0c48ad8186513721ebf744"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "7813b11353443fab14bf0a6a0cd89ae1"
server_key_iv: "79e851edb4a6b6d3070cc0d05cf74a4b"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.854041 8660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "38643032ef0c48ad8186513721ebf744"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "7813b11353443fab14bf0a6a0cd89ae1"
server_key_iv: "79e851edb4a6b6d3070cc0d05cf74a4b"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.857813 8660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 07:58:03.860229 8675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.861480 8660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:03.861655 8660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "38643032ef0c48ad8186513721ebf744"
format_stamp: "Formatted at 2026-08-09 07:58:03 on dist-test-slave-njxd"
server_key: "7813b11353443fab14bf0a6a0cd89ae1"
server_key_iv: "79e851edb4a6b6d3070cc0d05cf74a4b"
server_key_version: "encryptionkey@0"
I20260809 07:58:03.861769 8660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:03.886448 8660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:03.889353 8660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:03.889552 8660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:03.890198 8660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:03.891014 8660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:03.891059 8660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.891124 8660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:03.891165 8660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:03.899731 8660 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33351
I20260809 07:58:03.899845 8795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33351 every 8 connection(s)
I20260809 07:58:03.900647 8660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:03.901315 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 8660
I20260809 07:58:03.901432 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:03.901746 8397 external_mini_cluster.cc:1428] Setting key 52399b39796e15813e95204026f2b0cb
Aug 09 07:58:03 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262283, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:03.916888 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:03.902664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55829 (local address 127.8.51.126:38699)
0809 07:58:03.902810 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:03.902814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:03.904310 (+ 1496us) server_negotiation.cc:407] Connection header received
0809 07:58:03.905750 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:03.905755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:03.905817 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:03.905900 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:03.907548 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.908047 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.909936 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.910145 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.910226 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:03.912971 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:03.912976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:03.912980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:03.913011 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:03.914452 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.915173 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.915177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.915179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.915340 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:03.915730 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:03.915733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:03.915735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:03.915924 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:03.916032 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:03.916614 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 07:58:03.916726 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:03.917972 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:03.903141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38699 (local address 127.8.51.66:55829)
0809 07:58:03.904134 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:03.904192 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:03.905457 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:03.906132 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:03.906141 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:03.906734 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:03.907392 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:03.907414 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.908182 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.908186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:03.909807 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:03.909823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:03.910311 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:03.910317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:03.910524 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:03.911148 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:03.911171 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:03.912783 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:03.914658 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:03.914664 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:03.914678 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:03.915014 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:03.915443 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:03.915447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:03.915449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:03.915627 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:03.916030 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:03.916037 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:03.916384 (+ 347us) client_negotiation.cc:769] Sending connection context
0809 07:58:03.916563 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 07:58:03.916845 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":573,"threads_started":1}
I20260809 07:58:03.919175 8796 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38699
I20260809 07:58:03.919422 8796 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:03.919902 8796 heartbeater.cc:511] Master 127.8.51.126:38699 requested a full tablet report, sending...
I20260809 07:58:03.920939 8452 ts_manager.cc:194] Registered new tserver with Master: 38643032ef0c48ad8186513721ebf744 (127.8.51.66:33351)
I20260809 07:58:03.921512 8452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:55829
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:03.930421 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:04.040355 8801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:04.040601 8801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:04.040643 8801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:04.044652 8801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:04.044704 8801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:04.044804 8801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:04.049804 8801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:04.050776 8801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:04.051780 8801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:04.061127 8806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:04.061084 8807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:04.061268 8801 server_base.cc:1034] running on GCE node
W20260809 07:58:04.061071 8809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:04.061846 8801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:04.062423 8801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:04.063583 8801 hybrid_clock.cc:648] HybridClock initialized: now 1786262284063566 us; error 26 us; skew 500 ppm
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:04.066452 8801 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:04.067329 8801 webserver.cc:460] Webserver started at http://127.8.51.67:41101/ using document root <none> and password file <none>
I20260809 07:58:04.067898 8801 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:04.067991 8801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:04.068239 8801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:04.070418 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "57d8867a333b4b7e8a35cbec1e55ea6d"
format_stamp: "Formatted at 2026-08-09 07:58:04 on dist-test-slave-njxd"
server_key: "cbbc845a9fe8f1e93d42e400ee34644a"
server_key_iv: "5c925c6ef6bdb15852713e24b7fcea6e"
server_key_version: "encryptionkey@0"
I20260809 07:58:04.070976 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "57d8867a333b4b7e8a35cbec1e55ea6d"
format_stamp: "Formatted at 2026-08-09 07:58:04 on dist-test-slave-njxd"
server_key: "cbbc845a9fe8f1e93d42e400ee34644a"
server_key_iv: "5c925c6ef6bdb15852713e24b7fcea6e"
server_key_version: "encryptionkey@0"
I20260809 07:58:04.074579 8801 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 07:58:04.076915 8817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:04.078087 8801 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:04.078217 8801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "57d8867a333b4b7e8a35cbec1e55ea6d"
format_stamp: "Formatted at 2026-08-09 07:58:04 on dist-test-slave-njxd"
server_key: "cbbc845a9fe8f1e93d42e400ee34644a"
server_key_iv: "5c925c6ef6bdb15852713e24b7fcea6e"
server_key_version: "encryptionkey@0"
I20260809 07:58:04.078328 8801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:04.097070 8801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:04.100567 8801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:04.100788 8801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:04.101400 8801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:04.102299 8801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:04.102380 8801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:04.102456 8801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:04.102511 8801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:04.111514 8801 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:34931
I20260809 07:58:04.111537 8939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:34931 every 8 connection(s)
I20260809 07:58:04.112406 8801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:04.116820 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 8801
I20260809 07:58:04.116969 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:04.117295 8397 external_mini_cluster.cc:1428] Setting key e196ae70b5c2dbc31768ce2ac41e4e60
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:04.126487 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:04.114264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38165 (local address 127.8.51.126:38699)
0809 07:58:04.114423 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:04.114429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:04.115358 (+ 929us) server_negotiation.cc:407] Connection header received
0809 07:58:04.116976 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:04.116983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:04.117050 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:04.117154 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:04.118609 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.119290 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.120515 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.120807 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.120893 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:04.123206 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:04.123209 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:04.123212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:04.123243 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:04.124727 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.125155 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.125157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.125159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.125236 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.125520 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.125522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.125523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.125747 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:04.125825 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:04.126276 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 07:58:04.126368 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:04.127285 8942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:04.114692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38699 (local address 127.8.51.67:38165)
0809 07:58:04.115211 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:04.115253 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:04.116730 (+ 1477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:04.117326 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:04.117333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:04.117820 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:04.118470 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:04.118488 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.119411 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.119414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:04.120376 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:04.120386 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.120940 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.120943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:04.121080 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:04.121638 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:04.121653 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:04.123049 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:04.124823 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:04.124827 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:04.124838 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:04.125072 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:04.125313 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:04.125315 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:04.125316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:04.125441 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:04.125837 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:04.125841 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:04.126065 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 07:58:04.126223 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 07:58:04.126460 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
I20260809 07:58:04.128459 8940 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38699
I20260809 07:58:04.128726 8940 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:04.129207 8940 heartbeater.cc:511] Master 127.8.51.126:38699 requested a full tablet report, sending...
I20260809 07:58:04.130228 8452 ts_manager.cc:194] Registered new tserver with Master: 57d8867a333b4b7e8a35cbec1e55ea6d (127.8.51.67:34931)
I20260809 07:58:04.130975 8452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:38165
I20260809 07:58:04.131758 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:04.159049 8947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:04.149409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35402 (local address 127.8.51.65:42003)
0809 07:58:04.149781 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:04.149796 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:04.149819 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:58:04.149870 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:04.149875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:04.150050 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:04.150176 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:04.150785 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.151539 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.152313 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.152670 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.152753 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:04.155695 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:04.155704 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:04.155717 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:04.155739 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:04.157448 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.157897 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.157902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.157904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.157980 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.158221 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.158224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.158225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.158470 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:04.158629 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:04.158775 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 07:58:04.158897 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":141,"threads_started":1}
W20260809 07:58:04.159981 8563 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35402
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:04.186084 8947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:04.178279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35410 (local address 127.8.51.65:42003)
0809 07:58:04.178447 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:04.178451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:04.178498 (+ 47us) server_negotiation.cc:407] Connection header received
0809 07:58:04.178619 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:04.178622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:04.178663 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:04.178731 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:04.179374 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.179883 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.180663 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:04.180878 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:04.180952 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:04.183428 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:04.183432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:04.183434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:04.183455 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:04.184658 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.185016 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.185018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.185020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.185089 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:04.185307 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:04.185309 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:04.185310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:04.185450 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:04.185542 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:04.185788 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 07:58:04.185880 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 07:58:04.187021 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 8516
I20260809 07:58:04.194205 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 8660
I20260809 07:58:04.200950 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 8801
I20260809 07:58:04.207692 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 8417
2026-08-09T07:58:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2202 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8954](info): set up 2 sockets
Aug 09 07:58:04 dist-test-slave-njxd krb5kdc[8954](info): commencing operation
krb5kdc: starting...
W20260809 07:58:05.356873 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:05 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:05.561904 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36299
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36299
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:05.782207 8967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:05.782466 8967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:05.782506 8967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:05.786289 8967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:05.786341 8967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:05.786360 8967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:05.786376 8967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:05.786391 8967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:05.791553 8967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:05.792619 8967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:05.793745 8967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:05.802156 8975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:05.802171 8972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:05.802156 8973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:05.802358 8967 server_base.cc:1034] running on GCE node
I20260809 07:58:05.803061 8967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:05.804101 8967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:05.805258 8967 hybrid_clock.cc:648] HybridClock initialized: now 1786262285805230 us; error 41 us; skew 500 ppm
Aug 09 07:58:05 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262285, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:05.807994 8967 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:05.808911 8967 webserver.cc:460] Webserver started at http://127.8.51.126:43467/ using document root <none> and password file <none>
I20260809 07:58:05.809461 8967 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:05.809522 8967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:05.809836 8967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:05.812002 8967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "511ddf66b3e44bca8eeae920211dc033"
format_stamp: "Formatted at 2026-08-09 07:58:05 on dist-test-slave-njxd"
server_key: "8815066983c6f853de54c69a42414d25"
server_key_iv: "e8929be18b9c9466a853a7df538a750e"
server_key_version: "encryptionkey@0"
I20260809 07:58:05.812601 8967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "511ddf66b3e44bca8eeae920211dc033"
format_stamp: "Formatted at 2026-08-09 07:58:05 on dist-test-slave-njxd"
server_key: "8815066983c6f853de54c69a42414d25"
server_key_iv: "e8929be18b9c9466a853a7df538a750e"
server_key_version: "encryptionkey@0"
I20260809 07:58:05.816450 8967 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 07:58:05.818991 8982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:05.820281 8967 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:05.820425 8967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "511ddf66b3e44bca8eeae920211dc033"
format_stamp: "Formatted at 2026-08-09 07:58:05 on dist-test-slave-njxd"
server_key: "8815066983c6f853de54c69a42414d25"
server_key_iv: "e8929be18b9c9466a853a7df538a750e"
server_key_version: "encryptionkey@0"
I20260809 07:58:05.820555 8967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:05.832794 8967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:05.836017 8967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:05.836220 8967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:05.843387 8967 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:36299
I20260809 07:58:05.843458 9040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:36299 every 8 connection(s)
I20260809 07:58:05.844413 8967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:05.847350 9041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:05.852936 9041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: Bootstrap starting.
I20260809 07:58:05.853832 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 8967
I20260809 07:58:05.853950 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:05.854266 8397 external_mini_cluster.cc:1428] Setting key a23f2c43a9ecd279f47eecb0686b670f
I20260809 07:58:05.855965 9041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:05.856717 9041 log.cc:824] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:05.858855 9041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: No bootstrap required, opened a new log
Aug 09 07:58:05 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:05.863435 9041 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } }
I20260809 07:58:05.863651 9041 raft_consensus.cc:374] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:05.863685 9041 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511ddf66b3e44bca8eeae920211dc033, State: Initialized, Role: FOLLOWER
I20260809 07:58:05.864159 9041 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } }
I20260809 07:58:05.864279 9041 raft_consensus.cc:388] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:05.864379 9041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:05.864498 9041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:05.865324 9041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } }
I20260809 07:58:05.865708 9041 leader_election.cc:302] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 511ddf66b3e44bca8eeae920211dc033; no voters:
I20260809 07:58:05.866060 9041 leader_election.cc:288] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:05.866132 9047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:05.866374 9047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [term 1 LEADER]: Becoming Leader. State: Replica: 511ddf66b3e44bca8eeae920211dc033, State: Running, Role: LEADER
I20260809 07:58:05.866648 9047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } }
I20260809 07:58:05.867337 9041 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:05.868702 9049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "511ddf66b3e44bca8eeae920211dc033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } } }
I20260809 07:58:05.868831 9049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:05.869133 9048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511ddf66b3e44bca8eeae920211dc033. Latest consensus state: current_term: 1 leader_uuid: "511ddf66b3e44bca8eeae920211dc033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511ddf66b3e44bca8eeae920211dc033" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36299 } } }
I20260809 07:58:05.869220 9048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:05.869526 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:05.855450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46692 (local address 127.8.51.126:36299)
0809 07:58:05.855881 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:05.855896 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:05.855932 (+ 36us) server_negotiation.cc:407] Connection header received
0809 07:58:05.856580 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:05.856597 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:05.856980 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:05.857359 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:05.858219 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:05.859235 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:05.860394 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:05.860840 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:05.860957 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:05.863883 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:05.863888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:05.863901 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:05.863939 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:05.865878 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:05.866417 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:05.866485 (+ 68us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:05.866493 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:05.866627 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:05.867005 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:05.867007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:05.867008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:05.867378 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:05.867651 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:05.867989 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 07:58:05.868496 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":154,"threads_started":1}
W20260809 07:58:05.872485 9062 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:05.872581 9062 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:05.872707 9058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:05.873399 9058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:05.878682 9058 catalog_manager.cc:1347] Generated new cluster ID: 2d2ba9c458dd4b71846963a82841202c
I20260809 07:58:05.878744 9058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:05.892508 9058 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:05.893620 9058 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:05.902082 9058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 511ddf66b3e44bca8eeae920211dc033: Generated new TSK 0
I20260809 07:58:05.902850 9058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:05.930919 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:06.039675 9068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:06.039924 9068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:06.039990 9068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:06.043751 9068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:06.043828 9068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:06.043917 9068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:06.048743 9068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:06.049816 9068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:06.050800 9068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:06.059829 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:06.059882 9077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.060058 9068 server_base.cc:1034] running on GCE node
W20260809 07:58:06.060186 9075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.060601 9068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:06.061226 9068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:06.062388 9068 hybrid_clock.cc:648] HybridClock initialized: now 1786262286062374 us; error 24 us; skew 500 ppm
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:06.064966 9068 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:06.065858 9068 webserver.cc:460] Webserver started at http://127.8.51.65:35539/ using document root <none> and password file <none>
I20260809 07:58:06.066391 9068 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:06.066474 9068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:06.066685 9068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:06.068617 9068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "87b23be1406447958a35e37154ded3ac"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "add9a6f590f16fee5d6788936251db6f"
server_key_iv: "b815d3dbb81627ee2851def40b616126"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.069170 9068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "87b23be1406447958a35e37154ded3ac"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "add9a6f590f16fee5d6788936251db6f"
server_key_iv: "b815d3dbb81627ee2851def40b616126"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.072719 9068 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:58:06.075013 9084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.076186 9068 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:06.076321 9068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "87b23be1406447958a35e37154ded3ac"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "add9a6f590f16fee5d6788936251db6f"
server_key_iv: "b815d3dbb81627ee2851def40b616126"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.076422 9068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:06.088341 9068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:06.091120 9068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:06.091324 9068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:06.091881 9068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:06.092641 9068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:06.092710 9068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.092778 9068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:06.092823 9068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.101310 9068 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:44071
I20260809 07:58:06.101330 9205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:44071 every 8 connection(s)
I20260809 07:58:06.102200 9068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:06.107415 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9068
I20260809 07:58:06.107527 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:06.107800 8397 external_mini_cluster.cc:1428] Setting key 87f38cdfbadb45c4774da2b9487bf145
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:06.117018 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.103924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:57705 (local address 127.8.51.126:36299)
0809 07:58:06.104061 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.104064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.104897 (+ 833us) server_negotiation.cc:407] Connection header received
0809 07:58:06.106265 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.106269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.106325 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.106434 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.107672 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.108305 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.109670 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.109898 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.109980 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.112865 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.112871 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.112876 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.112909 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.114733 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.115324 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.115331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.115335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.115440 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.115822 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.115826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.115830 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.116105 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.116217 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.116677 (+ 460us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.116816 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 07:58:06.117758 9208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.104274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36299 (local address 127.8.51.65:57705)
0809 07:58:06.104713 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.104753 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.106042 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.106604 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.106610 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.106932 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:06.107517 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.107538 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.108427 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.108430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.109518 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.109531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.110074 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.110081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.110312 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.110921 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:06.110947 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:06.112706 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:06.114859 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.114866 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.114880 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.115200 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.115578 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.115580 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.115581 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.115708 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.116218 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:06.116222 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:06.116432 (+ 210us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.116592 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.116830 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:06.118993 9206 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36299
I20260809 07:58:06.119201 9206 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:06.119652 9206 heartbeater.cc:511] Master 127.8.51.126:36299 requested a full tablet report, sending...
I20260809 07:58:06.121189 9003 ts_manager.cc:194] Registered new tserver with Master: 87b23be1406447958a35e37154ded3ac (127.8.51.65:44071)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:06.122725 9003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:57705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:06.136853 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:06.245980 9211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:06.246307 9211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:06.246387 9211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:06.250713 9211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:06.250808 9211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:06.250900 9211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:06.256286 9211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:06.257385 9211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:06.258486 9211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:06.268651 9216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:06.268813 9217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.268893 9211 server_base.cc:1034] running on GCE node
W20260809 07:58:06.268646 9219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.269547 9211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:06.270244 9211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:06.271426 9211 hybrid_clock.cc:648] HybridClock initialized: now 1786262286271412 us; error 26 us; skew 500 ppm
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:06.274256 9211 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:06.275115 9211 webserver.cc:460] Webserver started at http://127.8.51.66:43315/ using document root <none> and password file <none>
I20260809 07:58:06.275641 9211 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:06.275707 9211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:06.275882 9211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:06.277985 9211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "8788effe729a98a4ca2de9283e8521aa"
server_key_iv: "d07312d53ef39e7822755887a7377f05"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.278496 9211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "8788effe729a98a4ca2de9283e8521aa"
server_key_iv: "d07312d53ef39e7822755887a7377f05"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.282281 9211 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 07:58:06.284714 9226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.286015 9211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:06.286131 9211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "8788effe729a98a4ca2de9283e8521aa"
server_key_iv: "d07312d53ef39e7822755887a7377f05"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.286237 9211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:06.307744 9211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:06.310568 9211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:06.310771 9211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:06.311542 9211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:06.312353 9211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:06.312399 9211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.312465 9211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:06.312497 9211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.321532 9211 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:46535
I20260809 07:58:06.321556 9345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:46535 every 8 connection(s)
I20260809 07:58:06.322494 9211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:06.323225 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9211
I20260809 07:58:06.323355 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:06.323633 8397 external_mini_cluster.cc:1428] Setting key ada2c5d458b0b28ee007c30214af0b80
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:06.337293 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.324479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55013 (local address 127.8.51.126:36299)
0809 07:58:06.324633 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.324638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.325444 (+ 806us) server_negotiation.cc:407] Connection header received
0809 07:58:06.326830 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.326836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.326896 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.326989 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.328496 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.328983 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.330834 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.331047 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.331131 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.333883 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.333887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.333889 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.333921 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.335313 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.335876 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.335878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.335879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.335949 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.336226 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.336228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.336229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.336376 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.336443 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.336946 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.337080 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 07:58:06.338070 9348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.324832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36299 (local address 127.8.51.66:55013)
0809 07:58:06.325288 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.325339 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.326618 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.327200 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.327209 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.327717 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:06.328373 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.328390 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.329108 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.329114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.330707 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.330723 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.331226 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.331234 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.331470 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.332059 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:06.332079 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:06.333714 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:06.335444 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.335449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.335460 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.335783 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.336020 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.336022 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.336023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.336146 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.336476 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:06.336484 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:06.336749 (+ 265us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.336888 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.337256 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":130,"threads_started":1}
I20260809 07:58:06.339236 9346 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36299
I20260809 07:58:06.339449 9346 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:06.339887 9346 heartbeater.cc:511] Master 127.8.51.126:36299 requested a full tablet report, sending...
I20260809 07:58:06.340875 9003 ts_manager.cc:194] Registered new tserver with Master: 626e83ee2d5b4b60b7b436cab1b2b5ce (127.8.51.66:46535)
I20260809 07:58:06.341416 9003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:55013
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:06.352012 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:06.458653 9352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:06.458895 9352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:06.458937 9352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:06.462783 9352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:06.462859 9352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:06.462915 9352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:06.468078 9352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36299
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:06.469110 9352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:06.470160 9352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:06.479645 9363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:06.479672 9359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.479692 9352 server_base.cc:1034] running on GCE node
W20260809 07:58:06.479857 9358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:06.480265 9352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:06.480952 9352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:06.482132 9352 hybrid_clock.cc:648] HybridClock initialized: now 1786262286482116 us; error 26 us; skew 500 ppm
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:06.484899 9352 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:06.485765 9352 webserver.cc:460] Webserver started at http://127.8.51.67:44481/ using document root <none> and password file <none>
I20260809 07:58:06.486289 9352 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:06.486346 9352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:06.486507 9352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:06.488476 9352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "be0a08e645dd4561be86f5e64b66cef7"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "2f7b06ef5ab3568f5709cfec41bf7627"
server_key_iv: "15a1ef772868f82df80c764c1b8926b8"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.489117 9352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "be0a08e645dd4561be86f5e64b66cef7"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "2f7b06ef5ab3568f5709cfec41bf7627"
server_key_iv: "15a1ef772868f82df80c764c1b8926b8"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.492828 9352 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:58:06.495173 9370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.496340 9352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 07:58:06.496464 9352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "be0a08e645dd4561be86f5e64b66cef7"
format_stamp: "Formatted at 2026-08-09 07:58:06 on dist-test-slave-njxd"
server_key: "2f7b06ef5ab3568f5709cfec41bf7627"
server_key_iv: "15a1ef772868f82df80c764c1b8926b8"
server_key_version: "encryptionkey@0"
I20260809 07:58:06.496573 9352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:06.517896 9352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:06.521358 9352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:06.521607 9352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:06.522240 9352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:06.523084 9352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:06.523134 9352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.523198 9352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:06.523231 9352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:06.532284 9352 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:42561
I20260809 07:58:06.532377 9493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:42561 every 8 connection(s)
I20260809 07:58:06.533226 9352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:06.537937 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9352
I20260809 07:58:06.538071 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:06.538417 8397 external_mini_cluster.cc:1428] Setting key 05512cc570997ca57d23e5c66b955c0d
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:06.547230 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.535229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:55263 (local address 127.8.51.126:36299)
0809 07:58:06.535396 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.535401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.536679 (+ 1278us) server_negotiation.cc:407] Connection header received
0809 07:58:06.537511 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.537513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.537561 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.537698 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.539155 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.539891 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.541161 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.541376 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.541458 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.543834 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.543838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.543841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.543869 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.545113 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.545681 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.545684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.545686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.545774 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.546118 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.546123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.546125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.546312 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.546422 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.546937 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.547056 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 07:58:06.548015 9496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.535626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36299 (local address 127.8.51.67:55263)
0809 07:58:06.536528 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.536571 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.537311 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.537914 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.537924 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.538429 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:06.539027 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.539040 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.540020 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.540023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.541054 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.541063 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.541503 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.541506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.541712 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.542236 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:06.542252 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:06.543671 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:06.545238 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.545243 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.545258 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.545516 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.545869 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:06.545873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:06.545875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:06.546016 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:06.546421 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:06.546428 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:06.546685 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.546882 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.547208 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":554,"threads_started":1}
I20260809 07:58:06.549139 9494 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36299
I20260809 07:58:06.549376 9494 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:06.549909 9494 heartbeater.cc:511] Master 127.8.51.126:36299 requested a full tablet report, sending...
I20260809 07:58:06.550932 9003 ts_manager.cc:194] Registered new tserver with Master: be0a08e645dd4561be86f5e64b66cef7 (127.8.51.67:42561)
I20260809 07:58:06.551671 9003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:55263
I20260809 07:58:06.552268 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:58:06.562415 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.555544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46704 (local address 127.8.51.126:36299)
0809 07:58:06.555688 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.555692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.555848 (+ 156us) server_negotiation.cc:407] Connection header received
0809 07:58:06.555929 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.555931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.555967 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.556031 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.556687 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.557179 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.558018 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.558236 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.558314 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.559515 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.559517 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.559519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.559541 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.560845 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.561255 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.561257 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.561259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.561329 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.561560 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.561562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.561563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.561792 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.561893 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.562136 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.562224 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 07:58:06.567348 9002 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46704:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:06.570720 9002 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:06.585186 9507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.579293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:42561 (local address 127.0.0.1:50964)
0809 07:58:06.579617 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.579721 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.579811 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.581506 (+ 1695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.581509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.581527 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:06.581710 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.581717 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.582669 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.582675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.583810 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.583819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.584651 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.584655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.584760 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.584800 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.584912 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.585019 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":20,"thread_start_us":77,"threads_started":1}
I20260809 07:58:06.585206 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.580249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50964 (local address 127.8.51.67:42561)
0809 07:58:06.581110 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.581122 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.581142 (+ 20us) server_negotiation.cc:407] Connection header received
0809 07:58:06.581215 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.581221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.581386 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.581525 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:06.581825 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.582543 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.583941 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.584530 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.584642 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.584785 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.584955 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.585047 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":759,"thread_start_us":152,"threads_started":1}
I20260809 07:58:06.586167 9509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.580005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44071 (local address 127.0.0.1:51134)
0809 07:58:06.580354 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.580366 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.580451 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.581313 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.581322 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.581350 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:06.581485 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.581492 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.583031 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.583037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.584354 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.584364 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.585690 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.585694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.585825 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.585858 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.585931 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.586010 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":92,"thread_start_us":117,"threads_started":1}
I20260809 07:58:06.586323 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.580670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.8.51.66:46535)
0809 07:58:06.580995 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.581004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.581023 (+ 19us) server_negotiation.cc:407] Connection header received
0809 07:58:06.581083 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.581087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.581260 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.581408 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:06.581877 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.582983 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.584482 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.585318 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.585427 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.585541 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.586086 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.586175 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":127,"threads_started":1}
I20260809 07:58:06.586560 9508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.579373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:46535 (local address 127.0.0.1:56128)
0809 07:58:06.579633 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.579671 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.579792 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.581559 (+ 1767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.581562 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.581579 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:06.581749 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.581756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.583113 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.583116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.584354 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.584364 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.585674 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.585677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.585812 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.585843 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.585916 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.585984 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":120,"thread_start_us":114,"threads_started":1}
I20260809 07:58:06.586957 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.580222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.8.51.65:44071)
0809 07:58:06.580798 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.580816 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.580842 (+ 26us) server_negotiation.cc:407] Connection header received
0809 07:58:06.580919 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.580924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.581140 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.581299 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:06.581646 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.582874 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.584497 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.585312 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.585432 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.585617 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.586724 (+ 1107us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.586818 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":66,"threads_started":1}
I20260809 07:58:06.588589 9420 tablet_service.cc:1467] Processing CreateTablet for tablet 3a6a87f935c64c9a9517f56f1501fea4 (DEFAULT_TABLE table=test-table [id=5d01dffcde824755b0af3089e3118777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:06.589365 9132 tablet_service.cc:1467] Processing CreateTablet for tablet 3a6a87f935c64c9a9517f56f1501fea4 (DEFAULT_TABLE table=test-table [id=5d01dffcde824755b0af3089e3118777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:06.589339 9276 tablet_service.cc:1467] Processing CreateTablet for tablet 3a6a87f935c64c9a9517f56f1501fea4 (DEFAULT_TABLE table=test-table [id=5d01dffcde824755b0af3089e3118777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:06.589974 9420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a6a87f935c64c9a9517f56f1501fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:06.590377 9132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a6a87f935c64c9a9517f56f1501fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:06.590377 9276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a6a87f935c64c9a9517f56f1501fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:06.596334 9513 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Bootstrap starting.
I20260809 07:58:06.597751 9515 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Bootstrap starting.
I20260809 07:58:06.598438 9514 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Bootstrap starting.
I20260809 07:58:06.599097 9513 tablet_bootstrap.cc:654] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:06.600437 9513 log.cc:824] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:06.600512 9515 tablet_bootstrap.cc:654] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:06.600942 9514 tablet_bootstrap.cc:654] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:06.601758 9515 log.cc:824] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:06.601812 9514 log.cc:824] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:06.602923 9513 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: No bootstrap required, opened a new log
I20260809 07:58:06.603148 9513 ts_tablet_manager.cc:1397] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 07:58:06.603693 9515 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: No bootstrap required, opened a new log
I20260809 07:58:06.603876 9515 ts_tablet_manager.cc:1397] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:58:06.607102 9513 raft_consensus.cc:348] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.607416 9513 raft_consensus.cc:374] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:06.607470 9513 raft_consensus.cc:729] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0a08e645dd4561be86f5e64b66cef7, State: Initialized, Role: FOLLOWER
I20260809 07:58:06.607607 9515 raft_consensus.cc:348] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.607882 9515 raft_consensus.cc:374] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:06.607999 9515 raft_consensus.cc:729] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b23be1406447958a35e37154ded3ac, State: Initialized, Role: FOLLOWER
I20260809 07:58:06.608000 9513 consensus_queue.cc:260] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.608503 9515 consensus_queue.cc:260] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.609045 9513 ts_tablet_manager.cc:1428] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 07:58:06.609211 9206 heartbeater.cc:503] Master 127.8.51.126:36299 was elected leader, sending a full tablet report...
I20260809 07:58:06.609364 9514 tablet_bootstrap.cc:492] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: No bootstrap required, opened a new log
I20260809 07:58:06.609407 9494 heartbeater.cc:503] Master 127.8.51.126:36299 was elected leader, sending a full tablet report...
I20260809 07:58:06.609432 9515 ts_tablet_manager.cc:1428] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 07:58:06.609544 9514 ts_tablet_manager.cc:1397] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260809 07:58:06.612950 9514 raft_consensus.cc:348] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.613270 9514 raft_consensus.cc:374] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:06.613340 9514 raft_consensus.cc:729] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626e83ee2d5b4b60b7b436cab1b2b5ce, State: Initialized, Role: FOLLOWER
I20260809 07:58:06.613830 9514 consensus_queue.cc:260] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.614773 9346 heartbeater.cc:503] Master 127.8.51.126:36299 was elected leader, sending a full tablet report...
I20260809 07:58:06.615020 9514 ts_tablet_manager.cc:1428] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:06.760604 9519 raft_consensus.cc:482] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:06.760865 9519 raft_consensus.cc:504] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.762066 9519 leader_election.cc:288] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 626e83ee2d5b4b60b7b436cab1b2b5ce (127.8.51.66:46535), 87b23be1406447958a35e37154ded3ac (127.8.51.65:44071)
I20260809 07:58:06.766043 9496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.762412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:46535 (local address 127.8.51.67:57377)
0809 07:58:06.762580 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.762597 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.762734 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.763100 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.763103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.763121 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:06.763244 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.763250 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.764013 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.764017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.764875 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.764883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.765549 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.765700 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.765723 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.765824 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.765896 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":23}
I20260809 07:58:06.766031 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.762486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:57377 (local address 127.8.51.66:46535)
0809 07:58:06.762631 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.762637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.762656 (+ 19us) server_negotiation.cc:407] Connection header received
0809 07:58:06.762903 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.762906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.762966 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.763067 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:06.763361 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.763882 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765021 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.765425 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765552 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.765641 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.765838 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.765905 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:06.766294 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.762877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:39999 (local address 127.8.51.65:44071)
0809 07:58:06.763033 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.763037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.763171 (+ 134us) server_negotiation.cc:407] Connection header received
0809 07:58:06.763299 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.763302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.763351 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.763435 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:06.763712 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.764198 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765300 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.765748 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765857 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.765916 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.766110 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.766195 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 07:58:06.766296 9522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.762722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44071 (local address 127.8.51.67:39999)
0809 07:58:06.763061 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:06.763074 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:06.763208 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:06.763449 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:06.763452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:06.763467 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:06.763596 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.763602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.764326 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.764331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.765161 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:06.765170 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.765871 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.765874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:06.765972 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.765993 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 07:58:06.766083 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 07:58:06.766160 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":18,"thread_start_us":137,"threads_started":1}
I20260809 07:58:06.766860 9296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a6a87f935c64c9a9517f56f1501fea4" candidate_uuid: "be0a08e645dd4561be86f5e64b66cef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" is_pre_election: true
I20260809 07:58:06.766853 9155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a6a87f935c64c9a9517f56f1501fea4" candidate_uuid: "be0a08e645dd4561be86f5e64b66cef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b23be1406447958a35e37154ded3ac" is_pre_election: true
I20260809 07:58:06.767266 9155 raft_consensus.cc:2454] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be0a08e645dd4561be86f5e64b66cef7 in term 0.
I20260809 07:58:06.767270 9296 raft_consensus.cc:2454] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be0a08e645dd4561be86f5e64b66cef7 in term 0.
I20260809 07:58:06.767899 9374 leader_election.cc:302] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 626e83ee2d5b4b60b7b436cab1b2b5ce, be0a08e645dd4561be86f5e64b66cef7; no voters:
I20260809 07:58:06.768215 9519 raft_consensus.cc:2781] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:06.768334 9519 raft_consensus.cc:482] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:06.768412 9519 raft_consensus.cc:3037] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:06.769634 9519 raft_consensus.cc:504] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.769973 9519 leader_election.cc:288] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [CANDIDATE]: Term 1 election: Requested vote from peers 626e83ee2d5b4b60b7b436cab1b2b5ce (127.8.51.66:46535), 87b23be1406447958a35e37154ded3ac (127.8.51.65:44071)
I20260809 07:58:06.770448 9296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a6a87f935c64c9a9517f56f1501fea4" candidate_uuid: "be0a08e645dd4561be86f5e64b66cef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce"
I20260809 07:58:06.770565 9296 raft_consensus.cc:3037] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:06.770572 9155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a6a87f935c64c9a9517f56f1501fea4" candidate_uuid: "be0a08e645dd4561be86f5e64b66cef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b23be1406447958a35e37154ded3ac"
I20260809 07:58:06.770735 9155 raft_consensus.cc:3037] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:06.771782 9296 raft_consensus.cc:2454] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be0a08e645dd4561be86f5e64b66cef7 in term 1.
I20260809 07:58:06.771960 9155 raft_consensus.cc:2454] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be0a08e645dd4561be86f5e64b66cef7 in term 1.
I20260809 07:58:06.772095 9374 leader_election.cc:302] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 626e83ee2d5b4b60b7b436cab1b2b5ce, be0a08e645dd4561be86f5e64b66cef7; no voters:
I20260809 07:58:06.772368 9519 raft_consensus.cc:2781] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:06.772626 9519 raft_consensus.cc:686] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [term 1 LEADER]: Becoming Leader. State: Replica: be0a08e645dd4561be86f5e64b66cef7, State: Running, Role: LEADER
I20260809 07:58:06.772997 9519 consensus_queue.cc:237] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } }
I20260809 07:58:06.776185 9002 catalog_manager.cc:5495] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7 reported cstate change: term changed from 0 to 1, leader changed from <none> to be0a08e645dd4561be86f5e64b66cef7 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "be0a08e645dd4561be86f5e64b66cef7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0a08e645dd4561be86f5e64b66cef7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "626e83ee2d5b4b60b7b436cab1b2b5ce" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b23be1406447958a35e37154ded3ac" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44071 } health_report { overall_health: UNKNOWN } } }
W20260809 07:58:06.784348 9495 tablet.cc:2369] T 3a6a87f935c64c9a9517f56f1501fea4 P be0a08e645dd4561be86f5e64b66cef7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:06.823668 9347 tablet.cc:2369] T 3a6a87f935c64c9a9517f56f1501fea4 P 626e83ee2d5b4b60b7b436cab1b2b5ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:06.828511 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.819508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.8.51.65:44071)
0809 07:58:06.819701 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.819706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.819849 (+ 143us) server_negotiation.cc:407] Connection header received
0809 07:58:06.820006 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.820009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.820078 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.820194 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.820970 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.821477 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.822362 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.822621 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.822739 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.825281 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.825292 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.825307 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.825331 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.826832 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.827277 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.827282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.827284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.827364 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.827635 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.827638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.827640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.827872 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.828091 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.828242 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.828356 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260809 07:58:06.853533 9207 tablet.cc:2369] T 3a6a87f935c64c9a9517f56f1501fea4 P 87b23be1406447958a35e37154ded3ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:06.857686 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.848137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.8.51.65:44071)
0809 07:58:06.848300 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.848304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.848423 (+ 119us) server_negotiation.cc:407] Connection header received
0809 07:58:06.848572 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.848575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.848619 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.848695 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.849505 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.850040 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.851228 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.851441 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.851512 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.854486 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.854489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.854491 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.854543 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.855975 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.856413 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.856416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.856418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.856488 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.856760 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.856764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.856766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.856927 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.857061 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.857359 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.857479 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[8954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:06.883273 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:06.875199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.8.51.65:44071)
0809 07:58:06.875375 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:06.875379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:06.875446 (+ 67us) server_negotiation.cc:407] Connection header received
0809 07:58:06.875554 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:06.875556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:06.875603 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:06.875671 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:06.876344 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.876835 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.877719 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:06.877932 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:06.878043 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:06.880396 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:06.880400 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:06.880403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:06.880449 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:06.881752 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.882125 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.882128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.882129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.882205 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:06.882459 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:06.882463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:06.882464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:06.882616 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:06.882742 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:06.882975 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 07:58:06.883088 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 07:58:06.885195 9112 tablet_service.cc:2908] Rejecting scan request for tablet 3a6a87f935c64c9a9517f56f1501fea4: Uninitialized: clean time has not yet been initialized
I20260809 07:58:06.887524 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9068
I20260809 07:58:06.897877 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9211
I20260809 07:58:06.904414 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9352
I20260809 07:58:06.911324 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 8967
2026-08-09T07:58:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2704 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[9537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[9537](info): set up 2 sockets
Aug 09 07:58:06 dist-test-slave-njxd krb5kdc[9537](info): commencing operation
krb5kdc: starting...
W20260809 07:58:07.970293 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:08.086833 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33663
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:33663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:08.193473 9552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:08.193789 9552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:08.193861 9552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:08.197813 9552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:08.197896 9552 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 07:58:08.197930 9552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:08.197973 9552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:08.198009 9552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:08.198064 9552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:08.202955 9552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:33663
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:08.203931 9552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:08.204885 9552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:08.213336 9560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.213336 9558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.213382 9552 server_base.cc:1034] running on GCE node
W20260809 07:58:08.213366 9562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.214159 9552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:08.215255 9552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:08.216445 9552 hybrid_clock.cc:648] HybridClock initialized: now 1786262288216432 us; error 36 us; skew 500 ppm
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:08.219274 9552 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:08.220065 9552 webserver.cc:460] Webserver started at http://127.8.51.126:39425/ using document root <none> and password file <none>
I20260809 07:58:08.220584 9552 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:08.220642 9552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:08.220808 9552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:08.222862 9552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "aeca8742bda74a82a641cc95a939ef53"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "8c7b2421c61d40b248b947fe7cfc0769"
server_key_iv: "a978b8cd5b28a84bbcc28e76b9411814"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.223383 9552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "aeca8742bda74a82a641cc95a939ef53"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "8c7b2421c61d40b248b947fe7cfc0769"
server_key_iv: "a978b8cd5b28a84bbcc28e76b9411814"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.227130 9552 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:58:08.229429 9569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.230670 9552 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:08.230768 9552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "aeca8742bda74a82a641cc95a939ef53"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "8c7b2421c61d40b248b947fe7cfc0769"
server_key_iv: "a978b8cd5b28a84bbcc28e76b9411814"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.230850 9552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:08.260097 9552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:08.263576 9552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:08.263737 9552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:08.271926 9552 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:33663
I20260809 07:58:08.271952 9633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:33663 every 8 connection(s)
I20260809 07:58:08.272886 9552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:08.275700 9634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:08.281215 9634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Bootstrap starting.
I20260809 07:58:08.282704 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9552
I20260809 07:58:08.282791 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:08.283021 8397 external_mini_cluster.cc:1428] Setting key a6510e0bec376a9862936dd456d62d43
I20260809 07:58:08.283828 9634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:08.284606 9634 log.cc:824] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:08.286761 9634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: No bootstrap required, opened a new log
I20260809 07:58:08.291188 9634 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } }
I20260809 07:58:08.291476 9634 raft_consensus.cc:374] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:08.291610 9634 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeca8742bda74a82a641cc95a939ef53, State: Initialized, Role: FOLLOWER
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:08.292102 9634 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } }
I20260809 07:58:08.292281 9634 raft_consensus.cc:388] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:08.292351 9634 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:08.292447 9634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:08.293295 9634 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } }
I20260809 07:58:08.293700 9634 leader_election.cc:302] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeca8742bda74a82a641cc95a939ef53; no voters:
I20260809 07:58:08.294061 9634 leader_election.cc:288] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:08.294142 9639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:08.294344 9639 raft_consensus.cc:686] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [term 1 LEADER]: Becoming Leader. State: Replica: aeca8742bda74a82a641cc95a939ef53, State: Running, Role: LEADER
I20260809 07:58:08.294723 9639 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } }
I20260809 07:58:08.295343 9634 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:08.295892 9642 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeca8742bda74a82a641cc95a939ef53. Latest consensus state: current_term: 1 leader_uuid: "aeca8742bda74a82a641cc95a939ef53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } } }
I20260809 07:58:08.296015 9642 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:08.296797 9641 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aeca8742bda74a82a641cc95a939ef53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeca8742bda74a82a641cc95a939ef53" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33663 } } }
I20260809 07:58:08.296962 9641 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:08.298708 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.284137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37976 (local address 127.8.51.126:33663)
0809 07:58:08.284653 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.284694 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.284740 (+ 46us) server_negotiation.cc:407] Connection header received
0809 07:58:08.285339 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.285356 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.285729 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.285998 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.286909 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.287845 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.289192 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.289723 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.289838 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.292713 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.292717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.292730 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.292754 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.294896 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.295369 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.295375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.295380 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.295526 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.295882 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.295885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.295887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.296410 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.296578 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.297434 (+ 856us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.297793 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":178,"threads_started":1}
W20260809 07:58:08.300344 9657 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:08.300432 9657 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:08.300529 9644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:08.301333 9644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:08.307114 9644 catalog_manager.cc:1347] Generated new cluster ID: a88b38f250064a229d2adc4c76d4bfad
I20260809 07:58:08.307181 9644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:08.315995 9644 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:08.316979 9644 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:08.324568 9644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Generated new TSK 0
I20260809 07:58:08.325289 9644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:08.358140 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33663
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:08.469727 9662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:08.469969 9662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:08.470009 9662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:08.473981 9662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:08.474035 9662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:08.474072 9662 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:08.474105 9662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:08.479144 9662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:08.480108 9662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:08.481063 9662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:08.490373 9668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.490442 9667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.490438 9670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.490681 9662 server_base.cc:1034] running on GCE node
I20260809 07:58:08.491176 9662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:08.491798 9662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:08.492971 9662 hybrid_clock.cc:648] HybridClock initialized: now 1786262288492937 us; error 46 us; skew 500 ppm
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:08.499958 9662 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:08.500931 9662 webserver.cc:460] Webserver started at http://127.8.51.65:45363/ using document root <none> and password file <none>
I20260809 07:58:08.501533 9662 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:08.501652 9662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:08.501899 9662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:08.504011 9662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "4ed244d3cb0840d58ec9812cb2d65f79"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "bd19918182e06dd265d6b6982fe66d8c"
server_key_iv: "4dd80b350262e1f5d5d3f4437e535b02"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.504702 9662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "4ed244d3cb0840d58ec9812cb2d65f79"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "bd19918182e06dd265d6b6982fe66d8c"
server_key_iv: "4dd80b350262e1f5d5d3f4437e535b02"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.508574 9662 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 07:58:08.511199 9677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.512458 9662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 07:58:08.512617 9662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "4ed244d3cb0840d58ec9812cb2d65f79"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "bd19918182e06dd265d6b6982fe66d8c"
server_key_iv: "4dd80b350262e1f5d5d3f4437e535b02"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.512732 9662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:08.528108 9662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:08.530972 9662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:08.531184 9662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:08.532622 9662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:08.532696 9662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.532773 9662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:08.532824 9662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:08.545094 9662 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:43905
I20260809 07:58:08.545090 9798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:43905 every 8 connection(s)
I20260809 07:58:08.546319 9662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:08.547612 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.533492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:36593 (local address 127.8.51.126:33663)
0809 07:58:08.533683 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.533687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.534770 (+ 1083us) server_negotiation.cc:407] Connection header received
0809 07:58:08.535862 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.535866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.535925 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.536033 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.537379 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.538280 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.539641 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.539890 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.540005 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.543370 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.543377 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.543384 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.543424 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.545242 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.545840 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.545843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.545844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.545922 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.546333 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.546336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.546338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.546610 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.546743 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.547317 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.547444 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:58:08.548324 9687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.534099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.65:36593)
0809 07:58:08.534589 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.534667 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.535642 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.536203 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.536210 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.536579 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.537196 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.537216 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.538418 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.538421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.539502 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.539512 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.540041 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.540045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.540227 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.540831 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.540847 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.543155 (+ 2308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.545359 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.545365 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.545378 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.545744 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.546018 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.546021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.546023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.546192 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.546753 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.546759 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.547041 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.547253 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.547560 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":142,"threads_started":1}
I20260809 07:58:08.549552 9799 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33663
I20260809 07:58:08.549711 9799 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:08.550271 9799 heartbeater.cc:511] Master 127.8.51.126:33663 requested a full tablet report, sending...
I20260809 07:58:08.551913 9585 ts_manager.cc:194] Registered new tserver with Master: 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905)
I20260809 07:58:08.553378 9585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:36593
I20260809 07:58:08.554735 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9662
I20260809 07:58:08.554855 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:08.555163 8397 external_mini_cluster.cc:1428] Setting key 9733bbaba8ca47f84ffc9cb205cc47a6
I20260809 07:58:08.559197 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.551910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:60857 (local address 127.8.51.126:33663)
0809 07:58:08.552041 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.552045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.552282 (+ 237us) server_negotiation.cc:407] Connection header received
0809 07:58:08.552365 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.552368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.552408 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.552483 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.552866 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.553607 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.554511 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.554732 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.554832 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.556082 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.556085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.556088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.556117 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.557529 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.558010 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.558014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.558016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.558095 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.558388 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.558392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.558394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.558559 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.558668 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.558926 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.559036 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:08.559209 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.551837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.65:60857)
0809 07:58:08.552182 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.552195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.552287 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.552504 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.552506 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.552669 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.552759 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.552764 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.553731 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.553733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.554372 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.554382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.554849 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.554852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.554955 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.555559 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.555574 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.555950 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.557705 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.557709 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.557710 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.557908 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.558206 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.558209 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.558211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.558296 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.558665 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.558668 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.558762 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.558873 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.559012 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:08.582156 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33663
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:08.692729 9809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:08.692983 9809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:08.693059 9809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:08.697211 9809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:08.697276 9809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:08.697335 9809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:08.697410 9809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:08.702337 9809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:08.703238 9809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:08.704221 9809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:08.713135 9814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.713137 9815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.713145 9817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.713198 9809 server_base.cc:1034] running on GCE node
I20260809 07:58:08.713785 9809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:08.714341 9809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:08.715523 9809 hybrid_clock.cc:648] HybridClock initialized: now 1786262288715515 us; error 34 us; skew 500 ppm
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:08.718454 9809 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:08.719184 9809 webserver.cc:460] Webserver started at http://127.8.51.66:44259/ using document root <none> and password file <none>
I20260809 07:58:08.719708 9809 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:08.719796 9809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:08.720033 9809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:08.722106 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "e66c7dc2f6234e6d837a0f0950135a88"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "c787e3781645a953a5583ee95b82dbcd"
server_key_iv: "9bdac72b16b7bdffb6132051f6e2c4a5"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.722890 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "e66c7dc2f6234e6d837a0f0950135a88"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "c787e3781645a953a5583ee95b82dbcd"
server_key_iv: "9bdac72b16b7bdffb6132051f6e2c4a5"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.726552 9809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:58:08.729035 9825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.730302 9809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:08.730441 9809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "e66c7dc2f6234e6d837a0f0950135a88"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "c787e3781645a953a5583ee95b82dbcd"
server_key_iv: "9bdac72b16b7bdffb6132051f6e2c4a5"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.730549 9809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:08.742663 9809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:08.745666 9809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:08.745853 9809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:08.747219 9809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:08.747285 9809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.747349 9809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:08.747394 9809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:08.758312 9809 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:38417
I20260809 07:58:08.758364 9944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:38417 every 8 connection(s)
I20260809 07:58:08.759418 9809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:08.761504 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.748060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:58145 (local address 127.8.51.126:33663)
0809 07:58:08.748247 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.748254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.749054 (+ 800us) server_negotiation.cc:407] Connection header received
0809 07:58:08.750288 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.750293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.750372 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.750500 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.752236 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.753133 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.754667 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.755071 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.755192 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.757529 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.757533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.757536 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.757563 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.759529 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.760115 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.760121 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.760124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.760240 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.760606 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.760609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.760610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.760777 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.760855 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.761281 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.761375 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 07:58:08.762245 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.748424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.66:58145)
0809 07:58:08.748891 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.748938 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.749987 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.750715 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.750723 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.751360 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.752073 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.752092 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.753292 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.753297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.754461 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.754471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.755223 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.755226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.755362 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.755951 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.755966 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.757367 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.759625 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.759630 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.759643 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.759985 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.760357 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.760360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.760361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.760490 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.760867 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.760872 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.761081 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.761230 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.761467 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":143,"threads_started":1}
I20260809 07:58:08.763326 9946 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33663
I20260809 07:58:08.763460 9946 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:08.763989 9946 heartbeater.cc:511] Master 127.8.51.126:33663 requested a full tablet report, sending...
I20260809 07:58:08.765066 9586 ts_manager.cc:194] Registered new tserver with Master: e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417)
I20260809 07:58:08.765822 9586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:58145
I20260809 07:58:08.768404 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9809
I20260809 07:58:08.768532 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:08.768879 8397 external_mini_cluster.cc:1428] Setting key edadc9523c6f83798f7214c371a8f1e7
I20260809 07:58:08.773010 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.765553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:50971 (local address 127.8.51.126:33663)
0809 07:58:08.765725 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.765730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.765886 (+ 156us) server_negotiation.cc:407] Connection header received
0809 07:58:08.765990 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.765994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.766044 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.766129 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.766610 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.767056 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.767983 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.768180 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.768255 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.769554 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.769557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.769559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.769638 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.771291 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.771743 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.771749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.771753 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.771845 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.772111 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.772117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.772122 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.772419 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.772540 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.772825 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.772910 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 07:58:08.773164 9953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.765498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.66:50971)
0809 07:58:08.765780 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.765795 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.765905 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.766151 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.766153 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.766355 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.766486 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.766494 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.767184 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.767187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.767878 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.767887 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.768292 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.768295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.768391 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.769000 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.769016 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.769438 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.771411 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.771414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.771415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.771615 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.771951 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.771953 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.771954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.772025 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.772531 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.772535 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.772637 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.772759 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.772922 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":1,"thread_start_us":128,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:08.796380 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33663
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:08.905025 9956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:08.905295 9956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:08.905390 9956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:08.909325 9956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:08.909390 9956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:08.909449 9956 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:08.909493 9956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:08.914611 9956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:08.915526 9956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:08.916481 9956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:08.925870 9964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:08.926016 9961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.926008 9956 server_base.cc:1034] running on GCE node
W20260809 07:58:08.925894 9962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:08.926654 9956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:08.927281 9956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:08.928465 9956 hybrid_clock.cc:648] HybridClock initialized: now 1786262288928435 us; error 41 us; skew 500 ppm
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:08.931233 9956 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:08.932029 9956 webserver.cc:460] Webserver started at http://127.8.51.67:39681/ using document root <none> and password file <none>
I20260809 07:58:08.932555 9956 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:08.932617 9956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:08.932780 9956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:08.935142 9956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "0dc4faa183d44c2dbd45893268c6b8d0"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "670cb3f1e1014864589a19ffaa651865"
server_key_iv: "f31baecf7b9a687d90e68043dd8ad3fb"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.935734 9956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "0dc4faa183d44c2dbd45893268c6b8d0"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "670cb3f1e1014864589a19ffaa651865"
server_key_iv: "f31baecf7b9a687d90e68043dd8ad3fb"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.939391 9956 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:08.942302 9972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.943487 9956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:08.943809 9956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "0dc4faa183d44c2dbd45893268c6b8d0"
format_stamp: "Formatted at 2026-08-09 07:58:08 on dist-test-slave-njxd"
server_key: "670cb3f1e1014864589a19ffaa651865"
server_key_iv: "f31baecf7b9a687d90e68043dd8ad3fb"
server_key_version: "encryptionkey@0"
I20260809 07:58:08.943938 9956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:08.966403 9956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:08.969336 9956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:08.969545 9956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:08.971033 9956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:08.971081 9956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:08.971154 9956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:08.971187 9956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:08 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:08.982442 9956 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:42597
I20260809 07:58:08.982540 10091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:42597 every 8 connection(s)
I20260809 07:58:08.983421 9956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:08.985103 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.971935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:49807 (local address 127.8.51.126:33663)
0809 07:58:08.972112 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.972119 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.973009 (+ 890us) server_negotiation.cc:407] Connection header received
0809 07:58:08.974324 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.974329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.974392 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.974495 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.976213 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.977070 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.978523 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.978767 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.978885 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.981413 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.981419 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.981427 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.981451 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.983146 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.983703 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.983708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.983710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.983793 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.984204 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.984207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.984209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.984393 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.984469 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.984894 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.984988 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 07:58:08.985965 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.972295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.67:49807)
0809 07:58:08.972823 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.972883 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.974047 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.974777 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.974789 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.975295 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.976034 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.976058 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.977193 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.977199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.978396 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.978406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.978928 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.978932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.979112 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.979737 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.979752 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.981247 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.983279 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.983284 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.983298 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.983592 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.983887 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.983891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.983894 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.984074 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.984471 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.984476 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.984688 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.984842 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.985074 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":153,"threads_started":1}
I20260809 07:58:08.987179 10092 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33663
I20260809 07:58:08.987339 10092 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:08.987859 10092 heartbeater.cc:511] Master 127.8.51.126:33663 requested a full tablet report, sending...
I20260809 07:58:08.988847 9585 ts_manager.cc:194] Registered new tserver with Master: 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597)
I20260809 07:58:08.989650 9585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:49807
I20260809 07:58:08.992949 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 9956
I20260809 07:58:08.993069 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:08.993340 8397 external_mini_cluster.cc:1428] Setting key 4d2699dbcb2b624e72b033d5804f324f
I20260809 07:58:08.995515 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:58:08.996392 10098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.989087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.8.51.67:37797)
0809 07:58:08.989472 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:08.989485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:08.989615 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:08.989847 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:08.989850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:08.990050 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:08.990143 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.990149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.990893 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.990897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.991690 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:08.991699 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.992063 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.992065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:08.992127 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.992628 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:08.992640 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:08.992925 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:08.994950 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.994952 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.994953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.995184 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.995485 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:08.995487 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:08.995488 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:08.995574 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:08.996016 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:08.996018 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:08.996091 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 07:58:08.996173 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 07:58:08.996274 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":108,"threads_started":1}
I20260809 07:58:08.996621 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:08.989203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37797 (local address 127.8.51.126:33663)
0809 07:58:08.989323 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:08.989327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:08.989560 (+ 233us) server_negotiation.cc:407] Connection header received
0809 07:58:08.989710 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:08.989712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:08.989745 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:08.989828 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:08.990276 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.990762 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.991788 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:08.991976 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:08.992045 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:08.993065 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:08.993068 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:08.993071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:08.993095 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:08.994845 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.995273 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.995277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.995279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.995384 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:08.995728 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:08.995731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:08.995733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:08.995925 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:08.996025 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:08.996288 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 07:58:08.996409 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[9537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262289, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262289, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:09.022228 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.014033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37982 (local address 127.8.51.126:33663)
0809 07:58:09.014153 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.014156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.014168 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:09.014206 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.014208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.014242 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.014302 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:09.015004 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.015558 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.016429 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.016726 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.016810 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.019195 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:09.019198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:09.019200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:09.019225 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:09.020692 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.021042 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.021044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.021046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.021138 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.021362 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.021364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.021365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.021526 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:09.021695 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.021897 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.021989 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 07:58:09.025013 9585 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:09.028031 9585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:09.042869 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.037734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.8.51.65:43905)
0809 07:58:09.038101 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.038118 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.038148 (+ 30us) server_negotiation.cc:407] Connection header received
0809 07:58:09.038216 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.038221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.038405 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.038577 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.038771 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.039787 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.041378 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042242 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042389 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042533 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.042607 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.042701 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":83,"threads_started":1}
I20260809 07:58:09.043109 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.038351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.8.51.67:42597)
0809 07:58:09.038795 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.038808 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.038829 (+ 21us) server_negotiation.cc:407] Connection header received
0809 07:58:09.038898 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.038903 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.039060 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.039200 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.039418 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.040414 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.041483 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042248 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042363 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042533 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.042860 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.042967 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":117,"threads_started":1}
I20260809 07:58:09.043404 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.036845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40762 (local address 127.8.51.66:38417)
0809 07:58:09.037300 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.037312 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.037350 (+ 38us) server_negotiation.cc:407] Connection header received
0809 07:58:09.037553 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.037558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.037825 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.037975 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.038433 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.039576 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.041260 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042002 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042129 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042302 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.043145 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.043261 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":104,"threads_started":1}
I20260809 07:58:09.042714 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.036756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38417 (local address 127.0.0.1:40762)
0809 07:58:09.037131 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.037187 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.037338 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.038152 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.038159 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.038184 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.038307 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.038314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.039674 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.039679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.041126 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.041137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042129 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.042260 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042305 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.042415 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.042546 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":101,"threads_started":1}
I20260809 07:58:09.042721 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.037541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:43905 (local address 127.0.0.1:53894)
0809 07:58:09.037838 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.037853 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.037938 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.038562 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.038565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.038583 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.038681 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.038689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.040111 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.040114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.041248 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.041255 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042399 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.042499 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042517 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.042565 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.042614 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":167,"threads_started":1}
I20260809 07:58:09.043789 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.037933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:42597 (local address 127.0.0.1:60386)
0809 07:58:09.038131 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.038144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.038238 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.039203 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.039206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.039226 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.039308 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.039314 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.040524 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.040529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.041350 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.041360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.042598 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.042601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.042704 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.042725 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.042796 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.042860 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260809 07:58:09.046308 9877 tablet_service.cc:1467] Processing CreateTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac (DEFAULT_TABLE table=test-table [id=f5e2bae8975d4de5afb6320cc602ede8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.046353 10022 tablet_service.cc:1467] Processing CreateTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac (DEFAULT_TABLE table=test-table [id=f5e2bae8975d4de5afb6320cc602ede8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.047374 9877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fc5e68a92d40799d33bb80752ea2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.047384 10022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fc5e68a92d40799d33bb80752ea2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.047358 9730 tablet_service.cc:1467] Processing CreateTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac (DEFAULT_TABLE table=test-table [id=f5e2bae8975d4de5afb6320cc602ede8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.048370 9730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fc5e68a92d40799d33bb80752ea2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.054924 10116 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Bootstrap starting.
I20260809 07:58:09.056049 10117 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Bootstrap starting.
I20260809 07:58:09.057435 10116 tablet_bootstrap.cc:654] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.058023 10117 tablet_bootstrap.cc:654] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.058389 10116 log.cc:824] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:09.058766 10117 log.cc:824] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:09.059186 10118 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Bootstrap starting.
I20260809 07:58:09.060374 10116 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: No bootstrap required, opened a new log
I20260809 07:58:09.060582 10116 ts_tablet_manager.cc:1397] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260809 07:58:09.061309 10118 tablet_bootstrap.cc:654] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.062146 10118 log.cc:824] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:09.063005 10117 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: No bootstrap required, opened a new log
I20260809 07:58:09.063210 10117 ts_tablet_manager.cc:1397] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 07:58:09.064064 10118 tablet_bootstrap.cc:492] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: No bootstrap required, opened a new log
I20260809 07:58:09.064262 10118 ts_tablet_manager.cc:1397] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 07:58:09.064477 10116 raft_consensus.cc:348] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.064746 10116 raft_consensus.cc:374] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.064803 10116 raft_consensus.cc:729] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66c7dc2f6234e6d837a0f0950135a88, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.065255 10116 consensus_queue.cc:260] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.065996 9946 heartbeater.cc:503] Master 127.8.51.126:33663 was elected leader, sending a full tablet report...
I20260809 07:58:09.066334 10116 ts_tablet_manager.cc:1428] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260809 07:58:09.067022 10117 raft_consensus.cc:348] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.067327 10117 raft_consensus.cc:374] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.067391 10117 raft_consensus.cc:729] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dc4faa183d44c2dbd45893268c6b8d0, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.067814 10117 consensus_queue.cc:260] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.068007 10118 raft_consensus.cc:348] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.068264 10118 raft_consensus.cc:374] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.068336 10118 raft_consensus.cc:729] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed244d3cb0840d58ec9812cb2d65f79, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.068616 10092 heartbeater.cc:503] Master 127.8.51.126:33663 was elected leader, sending a full tablet report...
I20260809 07:58:09.068821 10117 ts_tablet_manager.cc:1428] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 07:58:09.069926 10118 consensus_queue.cc:260] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.070598 9799 heartbeater.cc:503] Master 127.8.51.126:33663 was elected leader, sending a full tablet report...
I20260809 07:58:09.072078 10118 ts_tablet_manager.cc:1428] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20260809 07:58:09.073045 10123 raft_consensus.cc:482] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:09.073272 10123 raft_consensus.cc:504] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.074618 10123 leader_election.cc:288] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417), 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905)
I20260809 07:58:09.080174 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.075267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:43905 (local address 127.8.51.67:51811)
0809 07:58:09.075636 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.075653 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.075749 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.076091 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.076094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.076108 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.076252 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.076258 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.077320 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.077323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.078685 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.078698 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.079703 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.079707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.079824 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.079852 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.079935 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.080005 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":114,"threads_started":1}
I20260809 07:58:09.080216 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.075617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:51811 (local address 127.8.51.65:43905)
0809 07:58:09.075735 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.075739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.075754 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:09.075873 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.075876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.075922 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.075964 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.076385 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.077159 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.078832 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.079553 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.079692 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.079800 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.079972 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.080055 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 07:58:09.080838 9750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fc5e68a92d40799d33bb80752ea2ac" candidate_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" is_pre_election: true
I20260809 07:58:09.081151 9750 raft_consensus.cc:2454] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dc4faa183d44c2dbd45893268c6b8d0 in term 0.
I20260809 07:58:09.083226 9976 leader_election.cc:302] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dc4faa183d44c2dbd45893268c6b8d0, 4ed244d3cb0840d58ec9812cb2d65f79; no voters:
I20260809 07:58:09.085666 10123 raft_consensus.cc:2781] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:09.085767 10123 raft_consensus.cc:482] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:09.085808 10123 raft_consensus.cc:3037] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.087277 10123 raft_consensus.cc:504] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.087663 10123 leader_election.cc:288] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417), 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905)
I20260809 07:58:09.088255 9750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fc5e68a92d40799d33bb80752ea2ac" candidate_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed244d3cb0840d58ec9812cb2d65f79"
I20260809 07:58:09.088433 9750 raft_consensus.cc:3037] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.089766 9750 raft_consensus.cc:2454] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dc4faa183d44c2dbd45893268c6b8d0 in term 1.
I20260809 07:58:09.090762 9976 leader_election.cc:302] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dc4faa183d44c2dbd45893268c6b8d0, 4ed244d3cb0840d58ec9812cb2d65f79; no voters:
I20260809 07:58:09.090929 10123 raft_consensus.cc:2781] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:09.091171 10123 raft_consensus.cc:686] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 0dc4faa183d44c2dbd45893268c6b8d0, State: Running, Role: LEADER
I20260809 07:58:09.091568 10123 consensus_queue.cc:237] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.092101 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.075032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38417 (local address 127.8.51.67:51475)
0809 07:58:09.075163 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.075179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.075265 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.088306 (+ 13041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.088309 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.088333 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.088460 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.088468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.089470 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.089473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.090714 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.090726 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.091649 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.091653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.091777 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.091805 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.091877 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.091958 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 07:58:09.092092 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.087899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:51475 (local address 127.8.51.66:38417)
0809 07:58:09.088026 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.088031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.088049 (+ 18us) server_negotiation.cc:407] Connection header received
0809 07:58:09.088104 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.088108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.088168 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.088255 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.088583 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.089364 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.090868 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.091435 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.091550 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.091616 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.091916 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.091989 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 07:58:09.093050 9896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fc5e68a92d40799d33bb80752ea2ac" candidate_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66c7dc2f6234e6d837a0f0950135a88"
I20260809 07:58:09.093053 9897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fc5e68a92d40799d33bb80752ea2ac" candidate_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66c7dc2f6234e6d837a0f0950135a88" is_pre_election: true
I20260809 07:58:09.093240 9896 raft_consensus.cc:3037] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.095217 9896 raft_consensus.cc:2454] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dc4faa183d44c2dbd45893268c6b8d0 in term 1.
I20260809 07:58:09.095173 9585 catalog_manager.cc:5495] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260809 07:58:09.111482 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.107639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.8.51.67:42597)
0809 07:58:09.107793 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.107798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.107813 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:09.108032 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.108035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.108092 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.108201 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:09.108463 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.108950 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.109924 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.110168 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.110277 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.110635 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.111030 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.111162 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.111276 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.111333 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 07:58:09.117336 9896 raft_consensus.cc:1261] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Refusing update from remote peer 0dc4faa183d44c2dbd45893268c6b8d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.117400 9750 raft_consensus.cc:1261] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Refusing update from remote peer 0dc4faa183d44c2dbd45893268c6b8d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.118037 10126 consensus_queue.cc:1035] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.118234 10123 consensus_queue.cc:1035] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.127264 10131 mvcc.cc:205] Tried to move back new op lower bound from 7316530336217251840 to 7316530336122380288. Current Snapshot: MvccSnapshot[applied={T|T < 7316530336217251840}]
I20260809 07:58:09.138325 9585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:09.138476 9585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:09.140959 9585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Sending DeleteTablet for 3 replicas of tablet 39fc5e68a92d40799d33bb80752ea2ac
I20260809 07:58:09.141741 9877 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:40762
I20260809 07:58:09.142066 9730 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53894
I20260809 07:58:09.142252 10022 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fc5e68a92d40799d33bb80752ea2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:60386
I20260809 07:58:09.142519 10140 tablet_replica.cc:330] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: stopping tablet replica
I20260809 07:58:09.142508 9585 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 07:58:09.142869 10140 raft_consensus.cc:2229] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 07:58:09.142903 9585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:09.143046 10139 tablet_replica.cc:330] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: stopping tablet replica
I20260809 07:58:09.143184 10140 raft_consensus.cc:2258] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.143457 10139 raft_consensus.cc:2229] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:09.143797 10139 raft_consensus.cc:2258] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.144290 10142 tablet_replica.cc:330] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: stopping tablet replica
I20260809 07:58:09.145109 10140 ts_tablet_manager.cc:1905] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.146095 10139 ts_tablet_manager.cc:1905] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.148037 9730 tablet_service.cc:1467] Processing CreateTablet for tablet 972e42c75d4b48c4b85274e0649605b0 (DEFAULT_TABLE table=test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.148327 9730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 972e42c75d4b48c4b85274e0649605b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.149021 10139 ts_tablet_manager.cc:1918] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:09.149119 10139 log.cc:1196] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/39fc5e68a92d40799d33bb80752ea2ac
I20260809 07:58:09.149485 10139 ts_tablet_manager.cc:1939] T 39fc5e68a92d40799d33bb80752ea2ac P e66c7dc2f6234e6d837a0f0950135a88: Deleting consensus metadata
I20260809 07:58:09.150810 9877 tablet_service.cc:1467] Processing CreateTablet for tablet 972e42c75d4b48c4b85274e0649605b0 (DEFAULT_TABLE table=test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.151068 9877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 972e42c75d4b48c4b85274e0649605b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.151145 10142 raft_consensus.cc:2229] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:09.151551 10142 raft_consensus.cc:2258] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.152108 10118 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Bootstrap starting.
I20260809 07:58:09.153100 10118 tablet_bootstrap.cc:654] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.153262 10116 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Bootstrap starting.
I20260809 07:58:09.154354 10116 tablet_bootstrap.cc:654] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.155165 9573 catalog_manager.cc:4841] TS e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417): tablet 39fc5e68a92d40799d33bb80752ea2ac (table test-table [id=f5e2bae8975d4de5afb6320cc602ede8]) successfully deleted
I20260809 07:58:09.155349 10022 tablet_service.cc:1467] Processing CreateTablet for tablet 972e42c75d4b48c4b85274e0649605b0 (DEFAULT_TABLE table=test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:09.155612 10022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 972e42c75d4b48c4b85274e0649605b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.156344 10142 ts_tablet_manager.cc:1905] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.158107 10117 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Bootstrap starting.
I20260809 07:58:09.158823 10142 ts_tablet_manager.cc:1918] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:09.158913 10142 log.cc:1196] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/39fc5e68a92d40799d33bb80752ea2ac
I20260809 07:58:09.159044 10117 tablet_bootstrap.cc:654] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.159266 10142 ts_tablet_manager.cc:1939] T 39fc5e68a92d40799d33bb80752ea2ac P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting consensus metadata
I20260809 07:58:09.159569 10140 ts_tablet_manager.cc:1918] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:09.159723 10140 log.cc:1196] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/39fc5e68a92d40799d33bb80752ea2ac
I20260809 07:58:09.160106 10140 ts_tablet_manager.cc:1939] T 39fc5e68a92d40799d33bb80752ea2ac P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting consensus metadata
I20260809 07:58:09.160452 10116 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: No bootstrap required, opened a new log
I20260809 07:58:09.160486 9573 catalog_manager.cc:4841] TS 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597): tablet 39fc5e68a92d40799d33bb80752ea2ac (table test-table [id=f5e2bae8975d4de5afb6320cc602ede8]) successfully deleted
I20260809 07:58:09.160557 10116 ts_tablet_manager.cc:1397] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 07:58:09.161089 10116 raft_consensus.cc:348] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.161223 10116 raft_consensus.cc:374] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.161265 10116 raft_consensus.cc:729] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66c7dc2f6234e6d837a0f0950135a88, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.161307 10117 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: No bootstrap required, opened a new log
I20260809 07:58:09.161386 10117 ts_tablet_manager.cc:1397] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:09.161409 10116 consensus_queue.cc:260] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.161857 10117 raft_consensus.cc:348] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.161965 10117 raft_consensus.cc:374] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.161999 10117 raft_consensus.cc:729] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dc4faa183d44c2dbd45893268c6b8d0, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.162127 10117 consensus_queue.cc:260] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.162292 10116 ts_tablet_manager.cc:1428] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:09.162427 10117 ts_tablet_manager.cc:1428] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:09.163101 10118 tablet_bootstrap.cc:492] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: No bootstrap required, opened a new log
I20260809 07:58:09.163194 10118 ts_tablet_manager.cc:1397] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260809 07:58:09.163852 10118 raft_consensus.cc:348] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.163964 10118 raft_consensus.cc:374] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.164009 10118 raft_consensus.cc:729] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed244d3cb0840d58ec9812cb2d65f79, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.164137 10118 consensus_queue.cc:260] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.164439 10118 ts_tablet_manager.cc:1428] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260809 07:58:09.164824 9573 catalog_manager.cc:4841] TS 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905): tablet 39fc5e68a92d40799d33bb80752ea2ac (table test-table [id=f5e2bae8975d4de5afb6320cc602ede8]) successfully deleted
I20260809 07:58:09.211067 10122 raft_consensus.cc:482] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:09.211236 10122 raft_consensus.cc:504] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.212448 10122 leader_election.cc:288] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905), 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597)
I20260809 07:58:09.217447 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.212855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:34537 (local address 127.8.51.65:43905)
0809 07:58:09.213002 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.213008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.213027 (+ 19us) server_negotiation.cc:407] Connection header received
0809 07:58:09.213091 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.213094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.213146 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.213255 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.214141 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.214696 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.216224 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.216848 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.216952 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.217026 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.217243 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.217320 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 07:58:09.217456 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.212663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:43905 (local address 127.8.51.66:34537)
0809 07:58:09.212899 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.212918 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.213011 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.213438 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.213441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.213459 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.214008 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.214018 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.214813 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.214817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.216076 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.216087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.216983 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.216989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.217102 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.217125 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.217214 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.217287 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":26}
I20260809 07:58:09.217706 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.213506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:38935 (local address 127.8.51.67:42597)
0809 07:58:09.213718 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.213723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.213739 (+ 16us) server_negotiation.cc:407] Connection header received
0809 07:58:09.213789 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.213792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.213836 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.213916 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.214218 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.214987 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.216450 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.216917 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.217050 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.217116 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.217468 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.217553 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 07:58:09.218080 10146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.212930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:42597 (local address 127.8.51.66:38935)
0809 07:58:09.213268 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.213281 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.213413 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.213941 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.213943 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.213959 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.214091 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.214100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.215106 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.215109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.216337 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.216345 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.217184 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.217191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.217280 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.217298 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.217838 (+ 540us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.217908 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":23,"thread_start_us":74,"threads_started":1}
I20260809 07:58:09.218214 9750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "972e42c75d4b48c4b85274e0649605b0" candidate_uuid: "e66c7dc2f6234e6d837a0f0950135a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" is_pre_election: true
I20260809 07:58:09.218358 9750 raft_consensus.cc:2454] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e66c7dc2f6234e6d837a0f0950135a88 in term 0.
I20260809 07:58:09.218575 10044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "972e42c75d4b48c4b85274e0649605b0" candidate_uuid: "e66c7dc2f6234e6d837a0f0950135a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" is_pre_election: true
I20260809 07:58:09.218766 9829 leader_election.cc:302] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ed244d3cb0840d58ec9812cb2d65f79, e66c7dc2f6234e6d837a0f0950135a88; no voters:
I20260809 07:58:09.218832 10044 raft_consensus.cc:2454] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e66c7dc2f6234e6d837a0f0950135a88 in term 0.
I20260809 07:58:09.219040 10122 raft_consensus.cc:2781] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:09.219105 10122 raft_consensus.cc:482] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:09.219141 10122 raft_consensus.cc:3037] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.220417 10122 raft_consensus.cc:504] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.220767 10122 leader_election.cc:288] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [CANDIDATE]: Term 1 election: Requested vote from peers 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905), 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597)
I20260809 07:58:09.221071 9750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "972e42c75d4b48c4b85274e0649605b0" candidate_uuid: "e66c7dc2f6234e6d837a0f0950135a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed244d3cb0840d58ec9812cb2d65f79"
I20260809 07:58:09.221181 9750 raft_consensus.cc:3037] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.221168 10044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "972e42c75d4b48c4b85274e0649605b0" candidate_uuid: "e66c7dc2f6234e6d837a0f0950135a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dc4faa183d44c2dbd45893268c6b8d0"
I20260809 07:58:09.221254 10044 raft_consensus.cc:3037] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.222268 10044 raft_consensus.cc:2454] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e66c7dc2f6234e6d837a0f0950135a88 in term 1.
I20260809 07:58:09.222309 9750 raft_consensus.cc:2454] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e66c7dc2f6234e6d837a0f0950135a88 in term 1.
I20260809 07:58:09.222579 9829 leader_election.cc:302] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ed244d3cb0840d58ec9812cb2d65f79, e66c7dc2f6234e6d837a0f0950135a88; no voters:
I20260809 07:58:09.222766 10122 raft_consensus.cc:2781] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:09.223017 10122 raft_consensus.cc:686] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 1 LEADER]: Becoming Leader. State: Replica: e66c7dc2f6234e6d837a0f0950135a88, State: Running, Role: LEADER
I20260809 07:58:09.223268 10122 consensus_queue.cc:237] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.225883 9584 catalog_manager.cc:5495] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "e66c7dc2f6234e6d837a0f0950135a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } health_report { overall_health: UNKNOWN } } }
W20260809 07:58:09.234531 10093 tablet.cc:2369] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:09.260594 9947 tablet.cc:2369] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262288, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:09.264878 10154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.255300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33663 (local address 127.0.0.1:37992)
0809 07:58:09.255664 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.255682 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.255817 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.256093 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.256097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.256627 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:09.256768 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.256777 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.257506 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.257510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.258394 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.258410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.258871 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.258875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.258964 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.259568 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:09.259584 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:09.261343 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:09.263267 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:09.263284 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:09.263289 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:09.263511 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:09.263825 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:09.263827 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:09.263829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:09.263905 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:09.264410 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:09.264420 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:09.264530 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.264622 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.264743 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":114,"threads_started":1}
I20260809 07:58:09.265563 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.255396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37992 (local address 127.8.51.126:33663)
0809 07:58:09.255536 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.255541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.255768 (+ 227us) server_negotiation.cc:407] Connection header received
0809 07:58:09.255912 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.255914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.255953 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.256023 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:09.256889 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.257388 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.258533 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.258740 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.258824 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.261489 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:09.261493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:09.261496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:09.261521 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:09.263139 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.263611 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.263615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.263617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.263724 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.264003 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.264007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.264009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.264256 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:09.264387 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.264702 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.264832 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:09.269686 9584 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:37992:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 07:58:09.270440 9584 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:09.275635 9730 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee516b0f8f34023911b2c67a08bfbcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b45f93fbec5146d7b616bb9836cf36f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:09.276047 9730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee516b0f8f34023911b2c67a08bfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.275930 9877 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee516b0f8f34023911b2c67a08bfbcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b45f93fbec5146d7b616bb9836cf36f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:09.276345 9877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee516b0f8f34023911b2c67a08bfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.278007 10022 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee516b0f8f34023911b2c67a08bfbcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b45f93fbec5146d7b616bb9836cf36f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:09.278378 10022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee516b0f8f34023911b2c67a08bfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:09.278990 10118 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: Bootstrap starting.
I20260809 07:58:09.280015 10118 tablet_bootstrap.cc:654] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.281131 10117 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: Bootstrap starting.
I20260809 07:58:09.281948 10116 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: Bootstrap starting.
I20260809 07:58:09.282032 10117 tablet_bootstrap.cc:654] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.282799 10118 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: No bootstrap required, opened a new log
I20260809 07:58:09.282819 10116 tablet_bootstrap.cc:654] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:09.282881 10118 ts_tablet_manager.cc:1397] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260809 07:58:09.283129 10117 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: No bootstrap required, opened a new log
I20260809 07:58:09.283207 10117 ts_tablet_manager.cc:1397] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:09.283306 10118 raft_consensus.cc:348] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.283402 10118 raft_consensus.cc:374] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.283432 10118 raft_consensus.cc:729] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed244d3cb0840d58ec9812cb2d65f79, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.283550 10118 consensus_queue.cc:260] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.283595 10117 raft_consensus.cc:348] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.283689 10117 raft_consensus.cc:374] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.283716 10117 raft_consensus.cc:729] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dc4faa183d44c2dbd45893268c6b8d0, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.283831 10117 consensus_queue.cc:260] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.283847 10124 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.283986 10124 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.284062 10117 ts_tablet_manager.cc:1428] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:09.284233 10126 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.284354 10126 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.283856 10118 ts_tablet_manager.cc:1428] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:09.286697 10116 tablet_bootstrap.cc:492] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: No bootstrap required, opened a new log
I20260809 07:58:09.286777 10116 ts_tablet_manager.cc:1397] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 07:58:09.287448 10116 raft_consensus.cc:348] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.287549 10116 raft_consensus.cc:374] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:09.287575 10116 raft_consensus.cc:729] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66c7dc2f6234e6d837a0f0950135a88, State: Initialized, Role: FOLLOWER
I20260809 07:58:09.287680 10116 consensus_queue.cc:260] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.287914 10116 ts_tablet_manager.cc:1428] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:09.288097 10122 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.288204 10122 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 07:58:09.297978 9801 tablet.cc:2369] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:09.529657 10124 raft_consensus.cc:482] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:09.529794 10124 raft_consensus.cc:504] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.530776 10124 leader_election.cc:288] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417), 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597)
I20260809 07:58:09.536118 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.531671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:58053 (local address 127.8.51.67:42597)
0809 07:58:09.531799 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.531805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.531951 (+ 146us) server_negotiation.cc:407] Connection header received
0809 07:58:09.532058 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.532065 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.532106 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.532204 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.532441 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.533232 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.534834 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.535448 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.535570 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.535635 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.535920 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.535993 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:58:09.536118 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.531138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:50711 (local address 127.8.51.66:38417)
0809 07:58:09.531284 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.531288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.531474 (+ 186us) server_negotiation.cc:407] Connection header received
0809 07:58:09.531698 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.531702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.531754 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.531853 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:09.532183 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.533101 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.534834 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.535492 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.535586 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.535635 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.535920 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.535988 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 07:58:09.536198 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.531059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38417 (local address 127.8.51.65:50711)
0809 07:58:09.531365 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.531382 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.531504 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.531876 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.531882 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.531907 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.532061 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.532067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.533207 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.533209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.534712 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.534724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.535601 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.535604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.535758 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.535812 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.535890 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.536010 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":124,"spinlock_wait_cycles":10112,"thread_start_us":127,"threads_started":1}
I20260809 07:58:09.536381 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.531497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:42597 (local address 127.8.51.65:58053)
0809 07:58:09.531855 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.531867 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.531973 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.532222 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.532224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.532240 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:09.532329 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.532333 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.533338 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.533341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.534712 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.534724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.535587 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.535591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.535797 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.535813 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.535890 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.536010 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":136,"spinlock_wait_cycles":2560,"thread_start_us":126,"threads_started":1}
I20260809 07:58:09.536685 9896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee516b0f8f34023911b2c67a08bfbcd" candidate_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66c7dc2f6234e6d837a0f0950135a88" is_pre_election: true
I20260809 07:58:09.536846 9896 raft_consensus.cc:2454] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ed244d3cb0840d58ec9812cb2d65f79 in term 0.
I20260809 07:58:09.536900 10044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee516b0f8f34023911b2c67a08bfbcd" candidate_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" is_pre_election: true
I20260809 07:58:09.537019 10044 raft_consensus.cc:2454] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ed244d3cb0840d58ec9812cb2d65f79 in term 0.
I20260809 07:58:09.537232 9682 leader_election.cc:302] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ed244d3cb0840d58ec9812cb2d65f79, e66c7dc2f6234e6d837a0f0950135a88; no voters:
I20260809 07:58:09.537494 10124 raft_consensus.cc:2781] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:09.537570 10124 raft_consensus.cc:482] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:09.537647 10124 raft_consensus.cc:3037] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.538672 10124 raft_consensus.cc:504] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.539000 10124 leader_election.cc:288] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [CANDIDATE]: Term 1 election: Requested vote from peers e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417), 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597)
I20260809 07:58:09.539381 9896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee516b0f8f34023911b2c67a08bfbcd" candidate_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66c7dc2f6234e6d837a0f0950135a88"
I20260809 07:58:09.539422 10044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee516b0f8f34023911b2c67a08bfbcd" candidate_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dc4faa183d44c2dbd45893268c6b8d0"
I20260809 07:58:09.539527 9896 raft_consensus.cc:3037] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.539547 10044 raft_consensus.cc:3037] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:09.540377 9896 raft_consensus.cc:2454] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ed244d3cb0840d58ec9812cb2d65f79 in term 1.
I20260809 07:58:09.540545 10044 raft_consensus.cc:2454] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ed244d3cb0840d58ec9812cb2d65f79 in term 1.
I20260809 07:58:09.540696 9682 leader_election.cc:302] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ed244d3cb0840d58ec9812cb2d65f79, e66c7dc2f6234e6d837a0f0950135a88; no voters:
I20260809 07:58:09.540899 10124 raft_consensus.cc:2781] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:09.541117 10124 raft_consensus.cc:686] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 LEADER]: Becoming Leader. State: Replica: 4ed244d3cb0840d58ec9812cb2d65f79, State: Running, Role: LEADER
I20260809 07:58:09.541381 10124 consensus_queue.cc:237] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } }
I20260809 07:58:09.542519 10162 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: TxnStatusTablet state changed. Reason: New leader 4ed244d3cb0840d58ec9812cb2d65f79. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.542659 10162 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:09.542937 10164 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 07:58:09.543083 10164 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 07:58:09.543730 9585 catalog_manager.cc:5495] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:09.581290 10154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.577607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:43905 (local address 127.0.0.1:53904)
0809 07:58:09.577751 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.577769 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.577879 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.578231 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.578234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.578242 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:09.578349 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.578355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.579084 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.579088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.579701 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.579709 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.580167 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.580171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.580266 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.580315 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.580993 (+ 678us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.581010 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.581081 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.581176 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 07:58:09.581280 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.577726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53904 (local address 127.8.51.65:43905)
0809 07:58:09.577849 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.577854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.577869 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:09.578021 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.578025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.578078 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.578211 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:09.578465 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.578971 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.579827 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.580052 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.580161 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.580483 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.580893 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.581022 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.581090 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.581141 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:09.584105 9896 raft_consensus.cc:1261] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Refusing update from remote peer 4ed244d3cb0840d58ec9812cb2d65f79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.584219 10044 raft_consensus.cc:1261] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Refusing update from remote peer 4ed244d3cb0840d58ec9812cb2d65f79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.584671 10162 consensus_queue.cc:1035] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.584936 10124 consensus_queue.cc:1035] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.586313 10122 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: TxnStatusTablet state changed. Reason: New leader 4ed244d3cb0840d58ec9812cb2d65f79. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.586429 10122 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.586644 10126 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: TxnStatusTablet state changed. Reason: New leader 4ed244d3cb0840d58ec9812cb2d65f79. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.586767 10126 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.588845 10132 mvcc.cc:205] Tried to move back new op lower bound from 7316530338131214336 to 7316530337963851776. Current Snapshot: MvccSnapshot[applied={T|T < 7316530338131214336}]
I20260809 07:58:09.588953 10162 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.589056 10162 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:09.590477 10129 mvcc.cc:205] Tried to move back new op lower bound from 7316530338131214336 to 7316530337963851776. Current Snapshot: MvccSnapshot[applied={T|T < 7316530338131214336}]
I20260809 07:58:09.590588 10126 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.590688 10126 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 0dc4faa183d44c2dbd45893268c6b8d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.592193 10124 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.592321 10124 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P 4ed244d3cb0840d58ec9812cb2d65f79: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:09.593266 10122 tablet_replica.cc:439] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 } } peers { permanent_uuid: "e66c7dc2f6234e6d837a0f0950135a88" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38417 } } peers { permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 } } }
I20260809 07:58:09.593377 10122 tablet_replica.cc:442] T 8ee516b0f8f34023911b2c67a08bfbcd P e66c7dc2f6234e6d837a0f0950135a88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:09.599606 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.595490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40768 (local address 127.8.51.66:38417)
0809 07:58:09.595601 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.595611 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.595675 (+ 64us) server_negotiation.cc:407] Connection header received
0809 07:58:09.595866 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.595869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.595980 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.596084 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:09.596304 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.596974 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.598178 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.598381 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.598457 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.598762 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.599229 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.599316 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.599417 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.599460 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 07:58:09.610447 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.606892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:50531 (local address 127.8.51.65:43905)
0809 07:58:09.607024 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.607028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.607162 (+ 134us) server_negotiation.cc:407] Connection header received
0809 07:58:09.607285 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.607287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.607329 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.607391 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:09.607673 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.608159 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.609375 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.609570 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.609701 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.610060 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.610124 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.610180 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.610299 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.610341 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:09.610526 10173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.606731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:43905 (local address 127.8.51.66:50531)
0809 07:58:09.607068 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.607086 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.607193 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.607424 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.607427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.607435 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:09.607557 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.607563 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.608259 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.608263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.609254 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.609266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.609732 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.609736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.609833 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.609887 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.610207 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.610214 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.610281 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.610359 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":131,"threads_started":1}
I20260809 07:58:09.617844 10044 raft_consensus.cc:1261] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Refusing update from remote peer e66c7dc2f6234e6d837a0f0950135a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.617848 9750 raft_consensus.cc:1261] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Refusing update from remote peer e66c7dc2f6234e6d837a0f0950135a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:09.618340 10147 consensus_queue.cc:1035] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dc4faa183d44c2dbd45893268c6b8d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.618600 10122 consensus_queue.cc:1035] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ed244d3cb0840d58ec9812cb2d65f79" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:09.645375 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.638964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:52227 (local address 127.8.51.66:38417)
0809 07:58:09.639093 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.639097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.641905 (+ 2808us) server_negotiation.cc:407] Connection header received
0809 07:58:09.642017 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.642019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.642060 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.642121 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:09.642377 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.642876 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.644134 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.644478 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.644550 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.644964 (+ 414us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.645032 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.645089 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.645204 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.645249 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 07:58:09.645464 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.638905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38417 (local address 127.8.51.65:52227)
0809 07:58:09.641814 (+ 2909us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:09.641831 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:09.641938 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:09.642153 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:09.642156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:09.642166 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:09.642275 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.642281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.642982 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.642986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.643986 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:09.643998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.644676 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.644679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:09.644766 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.644818 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:09.645118 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:09.645125 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:58:09.645198 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 07:58:09.645280 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2780,"thread_start_us":111,"threads_started":1}
I20260809 07:58:09.670296 9585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:09.670495 9585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:09.672832 9585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aeca8742bda74a82a641cc95a939ef53: Sending DeleteTablet for 3 replicas of tablet 972e42c75d4b48c4b85274e0649605b0
I20260809 07:58:09.673554 9877 tablet_service.cc:1514] Processing DeleteTablet for tablet 972e42c75d4b48c4b85274e0649605b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:40762
I20260809 07:58:09.673609 9730 tablet_service.cc:1514] Processing DeleteTablet for tablet 972e42c75d4b48c4b85274e0649605b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53894
I20260809 07:58:09.674160 10022 tablet_service.cc:1514] Processing DeleteTablet for tablet 972e42c75d4b48c4b85274e0649605b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:09 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:60386
I20260809 07:58:09.675462 10182 tablet_replica.cc:330] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: stopping tablet replica
I20260809 07:58:09.675634 10182 raft_consensus.cc:2229] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:09.675982 10182 raft_consensus.cc:2258] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.676674 10182 ts_tablet_manager.cc:1905] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.677767 10185 tablet_replica.cc:330] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: stopping tablet replica
I20260809 07:58:09.677960 10185 raft_consensus.cc:2229] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:09.678136 10185 raft_consensus.cc:2258] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.678889 10185 ts_tablet_manager.cc:1905] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.679554 10182 ts_tablet_manager.cc:1918] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:09.679633 10182 log.cc:1196] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/972e42c75d4b48c4b85274e0649605b0
I20260809 07:58:09.679909 10182 ts_tablet_manager.cc:1939] T 972e42c75d4b48c4b85274e0649605b0 P e66c7dc2f6234e6d837a0f0950135a88: Deleting consensus metadata
I20260809 07:58:09.680533 9573 catalog_manager.cc:4841] TS e66c7dc2f6234e6d837a0f0950135a88 (127.8.51.66:38417): tablet 972e42c75d4b48c4b85274e0649605b0 (table test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]) successfully deleted
I20260809 07:58:09.680821 10184 tablet_replica.cc:330] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: stopping tablet replica
I20260809 07:58:09.680936 10184 raft_consensus.cc:2229] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:09.681041 10184 raft_consensus.cc:2258] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:09.681720 10184 ts_tablet_manager.cc:1905] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:09.683609 10185 ts_tablet_manager.cc:1918] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:09.684397 10184 ts_tablet_manager.cc:1918] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:09.684473 10184 log.cc:1196] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/972e42c75d4b48c4b85274e0649605b0
I20260809 07:58:09.684739 10184 ts_tablet_manager.cc:1939] T 972e42c75d4b48c4b85274e0649605b0 P 4ed244d3cb0840d58ec9812cb2d65f79: Deleting consensus metadata
I20260809 07:58:09.685382 9573 catalog_manager.cc:4841] TS 4ed244d3cb0840d58ec9812cb2d65f79 (127.8.51.65:43905): tablet 972e42c75d4b48c4b85274e0649605b0 (table test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]) successfully deleted
I20260809 07:58:09.685647 10185 log.cc:1196] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/972e42c75d4b48c4b85274e0649605b0
I20260809 07:58:09.685931 10185 ts_tablet_manager.cc:1939] T 972e42c75d4b48c4b85274e0649605b0 P 0dc4faa183d44c2dbd45893268c6b8d0: Deleting consensus metadata
I20260809 07:58:09.686597 9573 catalog_manager.cc:4841] TS 0dc4faa183d44c2dbd45893268c6b8d0 (127.8.51.67:42597): tablet 972e42c75d4b48c4b85274e0649605b0 (table test-table [id=d219c1bab4824c7ca8a8f20f4f63ac14]) successfully deleted
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[9537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262289, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:09.695315 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.675660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53908 (local address 127.8.51.65:43905)
0809 07:58:09.675785 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.675790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.680243 (+ 4453us) server_negotiation.cc:407] Connection header received
0809 07:58:09.680888 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.680893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.680942 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.680994 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:09.684387 (+ 3393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.685172 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.686680 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.686993 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.687076 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.691085 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:09.691096 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:09.691110 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:09.691137 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:09.693113 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.693666 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.693673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.693674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.693783 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.694096 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.694099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.694100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.694387 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:09.694677 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.694858 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.695131 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 07:58:09.695750 9775 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53908
I20260809 07:58:09.706570 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:09.697794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.8.51.126:33663)
0809 07:58:09.697917 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:09.697921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:09.698071 (+ 150us) server_negotiation.cc:407] Connection header received
0809 07:58:09.698234 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:09.698237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:09.698284 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:09.698333 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:09.699151 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.699896 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.701037 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:09.701371 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:09.701440 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:09.703056 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:09.703059 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:09.703061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:09.703085 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:09.704745 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.705181 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.705184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.705186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.705261 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:09.705533 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:09.705536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:09.705538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:09.705843 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:09.705937 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:09.706307 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 07:58:09.706416 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 07:58:09.707681 9585 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37998
I20260809 07:58:09.708997 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9662
I20260809 07:58:09.717144 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9809
I20260809 07:58:09.724228 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9956
I20260809 07:58:09.731443 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 9552
2026-08-09T07:58:09Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2820 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[10192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[10192](info): set up 2 sockets
Aug 09 07:58:09 dist-test-slave-njxd krb5kdc[10192](info): commencing operation
krb5kdc: starting...
W20260809 07:58:10.791864 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:10 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:10.915957 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45753
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:11.023264 10205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:11.023514 10205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:11.023557 10205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:11.027455 10205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:11.027504 10205 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 07:58:11.027520 10205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:11.027537 10205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:11.027557 10205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:11.027602 10205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:11.032557 10205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45753
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:11.033479 10205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:11.034482 10205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:11.042793 10210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.042868 10205 server_base.cc:1034] running on GCE node
W20260809 07:58:11.042793 10213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:11.042788 10211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.043545 10205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:11.044500 10205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:11.045672 10205 hybrid_clock.cc:648] HybridClock initialized: now 1786262291045662 us; error 24 us; skew 500 ppm
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:11.048194 10205 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:11.049045 10205 webserver.cc:460] Webserver started at http://127.8.51.126:44373/ using document root <none> and password file <none>
I20260809 07:58:11.049659 10205 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:11.049757 10205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:11.049969 10205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:11.051946 10205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "44b4d8fca2504307b83b30939166a1d2"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "da986312c1c1a2e9b6941f087a9d6723"
server_key_iv: "e16aa0ec8044ee65d42e36c4e7f4dcc6"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.052498 10205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "44b4d8fca2504307b83b30939166a1d2"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "da986312c1c1a2e9b6941f087a9d6723"
server_key_iv: "e16aa0ec8044ee65d42e36c4e7f4dcc6"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.056257 10205 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 07:58:11.058619 10220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.059742 10205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:11.059890 10205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "44b4d8fca2504307b83b30939166a1d2"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "da986312c1c1a2e9b6941f087a9d6723"
server_key_iv: "e16aa0ec8044ee65d42e36c4e7f4dcc6"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.059996 10205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:11.069167 10205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:11.073167 10205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:11.073341 10205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:11.081709 10205 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45753
I20260809 07:58:11.081710 10285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45753 every 8 connection(s)
I20260809 07:58:11.082617 10205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:11.085182 10286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:11.090296 10286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Bootstrap starting.
I20260809 07:58:11.091928 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 10205
I20260809 07:58:11.092020 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:11.092299 8397 external_mini_cluster.cc:1428] Setting key f0b24938ebeb88c39cbe352250b74d09
I20260809 07:58:11.092716 10286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:11.093524 10286 log.cc:824] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:11.095467 10286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: No bootstrap required, opened a new log
I20260809 07:58:11.099435 10286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } }
I20260809 07:58:11.099741 10286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:11.099807 10286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b4d8fca2504307b83b30939166a1d2, State: Initialized, Role: FOLLOWER
I20260809 07:58:11.100319 10286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } }
I20260809 07:58:11.100485 10286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:11.100575 10286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:11.100695 10286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:11.101889 10286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } }
I20260809 07:58:11.102222 10286 leader_election.cc:302] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44b4d8fca2504307b83b30939166a1d2; no voters:
I20260809 07:58:11.102510 10286 leader_election.cc:288] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:11.102632 10291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:11.102873 10291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [term 1 LEADER]: Becoming Leader. State: Replica: 44b4d8fca2504307b83b30939166a1d2, State: Running, Role: LEADER
I20260809 07:58:11.103204 10291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } }
I20260809 07:58:11.103902 10286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:11.104817 10292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44b4d8fca2504307b83b30939166a1d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } } }
I20260809 07:58:11.104944 10292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:11.105273 10293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44b4d8fca2504307b83b30939166a1d2. Latest consensus state: current_term: 1 leader_uuid: "44b4d8fca2504307b83b30939166a1d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b4d8fca2504307b83b30939166a1d2" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45753 } } }
I20260809 07:58:11.105327 10302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:11.105396 10293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:11.107810 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.093369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.8.51.126:45753)
0809 07:58:11.093841 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.093864 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.093932 (+ 68us) server_negotiation.cc:407] Connection header received
0809 07:58:11.094673 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.094693 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.094997 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.095271 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.096186 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.097118 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.098319 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.098779 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.098894 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.101934 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.101939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.101952 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.102002 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.104204 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.104826 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.104835 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.104842 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.104987 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.105384 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.105388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.105390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.105940 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.106125 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.106644 (+ 519us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.106926 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":195,"threads_started":1}
I20260809 07:58:11.108525 10302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:11.114113 10302 catalog_manager.cc:1347] Generated new cluster ID: fe53327d03b44ae3892fe2386afb4af6
I20260809 07:58:11.114198 10302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:11.128367 10302 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:11.129566 10302 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:11.137861 10302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Generated new TSK 0
I20260809 07:58:11.138595 10302 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:11.168260 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45753
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:11.297165 10315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:11.297435 10315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:11.297482 10315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:11.301424 10315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:11.301491 10315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:11.301530 10315 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 07:58:11.301545 10315 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:11.301596 10315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:11.306999 10315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:11.307981 10315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:11.308974 10315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:11.318466 10322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.318518 10315 server_base.cc:1034] running on GCE node
W20260809 07:58:11.318475 10324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:11.318481 10321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.318993 10315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:11.319559 10315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:11.320749 10315 hybrid_clock.cc:648] HybridClock initialized: now 1786262291320729 us; error 33 us; skew 500 ppm
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:11.323606 10315 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:11.324400 10315 webserver.cc:460] Webserver started at http://127.8.51.65:42631/ using document root <none> and password file <none>
I20260809 07:58:11.324963 10315 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:11.325054 10315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:11.325294 10315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:11.327328 10315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "266a84acf5e3a6b265622ddf0e2d37c8"
server_key_iv: "cea27fa3acdf18baa3035236841a5622"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.327880 10315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "266a84acf5e3a6b265622ddf0e2d37c8"
server_key_iv: "cea27fa3acdf18baa3035236841a5622"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.331485 10315 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:11.333830 10332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.335011 10315 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:11.335152 10315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "266a84acf5e3a6b265622ddf0e2d37c8"
server_key_iv: "cea27fa3acdf18baa3035236841a5622"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.335263 10315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:11.351970 10315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:11.355028 10315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:11.355228 10315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:11.356577 10315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:11.356645 10315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.356711 10315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:11.356771 10315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:11.367514 10315 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:41783
I20260809 07:58:11.367565 10451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:41783 every 8 connection(s)
I20260809 07:58:11.368439 10315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:11.370504 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.357375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:47677 (local address 127.8.51.126:45753)
0809 07:58:11.357553 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.357559 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.358361 (+ 802us) server_negotiation.cc:407] Connection header received
0809 07:58:11.359282 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.359286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.359344 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.359407 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.361211 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.361999 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.363437 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.363833 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.363940 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.366758 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.366762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.366764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.366791 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.368316 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.368935 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.368938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.368940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.369040 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.369432 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.369435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.369436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.369681 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.369763 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.370274 (+ 511us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.370387 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 07:58:11.371210 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.357770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.65:47677)
0809 07:58:11.358186 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.358230 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.359032 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.359892 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.359900 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.360391 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.361060 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.361088 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.362111 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.362114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.363273 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.363303 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.364156 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.364160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.364363 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.364924 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.364939 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.366588 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.368437 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.368443 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.368457 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.368796 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.369153 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.369158 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.369163 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.369352 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.369770 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.369774 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.369982 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.370155 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.370392 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":111,"threads_started":1}
I20260809 07:58:11.372666 10452 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45753
I20260809 07:58:11.372807 10452 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:11.373286 10452 heartbeater.cc:511] Master 127.8.51.126:45753 requested a full tablet report, sending...
I20260809 07:58:11.375015 10237 ts_manager.cc:194] Registered new tserver with Master: a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783)
I20260809 07:58:11.375682 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 10315
I20260809 07:58:11.375806 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:11.376102 8397 external_mini_cluster.cc:1428] Setting key 0c40ae86dfc98c984f4807f524071de2
I20260809 07:58:11.376559 10237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:47677
I20260809 07:58:11.383566 10460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.374809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.65:48201)
0809 07:58:11.375080 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.375098 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.375228 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.376492 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.376495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.376712 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.376829 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.376836 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.377673 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.377679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.378536 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.378549 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.379061 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.379067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.379190 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.379648 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.379668 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.380113 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.382074 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.382077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.382078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.382260 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.382545 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.382547 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.382548 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.382632 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.383089 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.383091 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.383190 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.383298 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.383407 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260809 07:58:11.383703 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.374868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:48201 (local address 127.8.51.126:45753)
0809 07:58:11.374998 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.375002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.375164 (+ 162us) server_negotiation.cc:407] Connection header received
0809 07:58:11.375325 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.375327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.375366 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.375429 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.376952 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.377511 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.378683 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.378947 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.379028 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.380253 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.380259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.380264 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.380295 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.381960 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.382354 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.382360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.382365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.382456 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.382726 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.382732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.382736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.382983 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.383093 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.383404 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.383540 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:11.404747 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45753
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:11.516399 10464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:11.516664 10464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:11.516755 10464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:11.520807 10464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:11.520866 10464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:11.520943 10464 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 07:58:11.520977 10464 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:11.521044 10464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:11.526587 10464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:11.527702 10464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:11.528766 10464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:11.538393 10469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.538489 10464 server_base.cc:1034] running on GCE node
W20260809 07:58:11.538393 10470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:11.538430 10472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.539129 10464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:11.539793 10464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:11.540954 10464 hybrid_clock.cc:648] HybridClock initialized: now 1786262291540932 us; error 33 us; skew 500 ppm
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:11.543879 10464 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:11.544763 10464 webserver.cc:460] Webserver started at http://127.8.51.66:44775/ using document root <none> and password file <none>
I20260809 07:58:11.545351 10464 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:11.545445 10464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:11.545737 10464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:11.547783 10464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "13fdd531a60e4262ab80ed5f237ab092"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "697a21120641553fec2313fdf2bca421"
server_key_iv: "ce3dc85bf0e45a02de1fb938cc2448ee"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.548370 10464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "13fdd531a60e4262ab80ed5f237ab092"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "697a21120641553fec2313fdf2bca421"
server_key_iv: "ce3dc85bf0e45a02de1fb938cc2448ee"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.552187 10464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 07:58:11.554641 10479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.555864 10464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:11.556001 10464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "13fdd531a60e4262ab80ed5f237ab092"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "697a21120641553fec2313fdf2bca421"
server_key_iv: "ce3dc85bf0e45a02de1fb938cc2448ee"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.556142 10464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:11.584569 10464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:11.588162 10464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:11.588385 10464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:11.589964 10464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:11.590039 10464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.590124 10464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:11.590178 10464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:11.601442 10464 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33043
I20260809 07:58:11.602245 10597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33043 every 8 connection(s)
I20260809 07:58:11.602540 10464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:11.604169 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.590777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:50447 (local address 127.8.51.126:45753)
0809 07:58:11.590945 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.590952 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.592415 (+ 1463us) server_negotiation.cc:407] Connection header received
0809 07:58:11.593903 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.593908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.593976 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.594074 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.595346 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.595881 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.597288 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.597510 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.597635 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.600165 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.600168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.600170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.600195 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.601901 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.602507 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.602510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.602511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.602623 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.603041 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.603045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.603046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.603308 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.603414 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.603853 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.604016 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 07:58:11.604884 10489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.591692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.66:50447)
0809 07:58:11.592246 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.592304 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.593646 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.594280 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.594287 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.594719 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.595194 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.595206 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.596009 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.596013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.597146 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.597167 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.597704 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.597708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.597872 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.598444 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.598460 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.599990 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.602022 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.602028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.602042 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.602395 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.602722 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.602725 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.602727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.602908 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.603411 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.603416 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.603628 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.603791 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.604078 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":151,"threads_started":1}
I20260809 07:58:11.606176 10598 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45753
I20260809 07:58:11.606312 10598 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:11.606841 10598 heartbeater.cc:511] Master 127.8.51.126:45753 requested a full tablet report, sending...
I20260809 07:58:11.607967 10237 ts_manager.cc:194] Registered new tserver with Master: 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043)
I20260809 07:58:11.608742 10237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:50447
I20260809 07:58:11.611523 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 10464
I20260809 07:58:11.611610 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:11.611891 8397 external_mini_cluster.cc:1428] Setting key 43500b382c6b7f15c60939d7d8968e0b
I20260809 07:58:11.616084 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.608543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:58949 (local address 127.8.51.126:45753)
0809 07:58:11.608681 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.608684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.608922 (+ 238us) server_negotiation.cc:407] Connection header received
0809 07:58:11.609085 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.609087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.609136 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.609226 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.609687 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.610194 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.611016 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.611255 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.611365 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.612582 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.612586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.612589 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.612616 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.614305 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.614733 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.614739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.614744 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.614843 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.615104 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.615110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.615115 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.615416 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.615526 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.615754 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.615892 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 07:58:11.616088 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.608467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.66:58949)
0809 07:58:11.608840 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.608858 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.608984 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.609251 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.609253 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.609418 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.609533 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.609538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.610322 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.610325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.610894 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.610902 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.611370 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.611373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.611469 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.612082 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.612097 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.612484 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.614418 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.614420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.614421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.614626 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.614935 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.614937 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.614938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.615014 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.615514 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.615516 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.615589 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.615672 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.615819 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:11.641088 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45753
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:11.752282 10609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:11.752529 10609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:11.752574 10609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:11.756564 10609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:11.756618 10609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:11.756661 10609 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 07:58:11.756675 10609 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:11.756705 10609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:11.761936 10609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:11.762888 10609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:11.763895 10609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:11.773646 10617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.773769 10609 server_base.cc:1034] running on GCE node
W20260809 07:58:11.773699 10614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:11.773722 10615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:11.774292 10609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:11.774989 10609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:11.776181 10609 hybrid_clock.cc:648] HybridClock initialized: now 1786262291776168 us; error 43 us; skew 500 ppm
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:11.779086 10609 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:11.779903 10609 webserver.cc:460] Webserver started at http://127.8.51.67:43953/ using document root <none> and password file <none>
I20260809 07:58:11.780429 10609 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:11.780486 10609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:11.780659 10609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:11.782732 10609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "345c09825d4045548c139db75e4b6b38"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "e400a297cf2fccc00808f1eb2e1bcd43"
server_key_iv: "7e51fd5a230029ef93976aed86e20bbd"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.783259 10609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "345c09825d4045548c139db75e4b6b38"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "e400a297cf2fccc00808f1eb2e1bcd43"
server_key_iv: "7e51fd5a230029ef93976aed86e20bbd"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.786960 10609 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:58:11.789566 10624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.790910 10609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:11.791049 10609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "345c09825d4045548c139db75e4b6b38"
format_stamp: "Formatted at 2026-08-09 07:58:11 on dist-test-slave-njxd"
server_key: "e400a297cf2fccc00808f1eb2e1bcd43"
server_key_iv: "7e51fd5a230029ef93976aed86e20bbd"
server_key_version: "encryptionkey@0"
I20260809 07:58:11.791164 10609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:11.811936 10609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:11.815326 10609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:11.815541 10609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:11.817054 10609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:11.817101 10609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:11.817139 10609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:11.817210 10609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:11.828899 10609 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:37359
I20260809 07:58:11.829005 10743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:37359 every 8 connection(s)
I20260809 07:58:11.829907 10609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:11.832144 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.818032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37301 (local address 127.8.51.126:45753)
0809 07:58:11.818166 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.818170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.819222 (+ 1052us) server_negotiation.cc:407] Connection header received
0809 07:58:11.820448 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.820451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.820516 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.820626 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.822057 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.822578 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.823840 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.824210 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.824330 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.828273 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.828277 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.828280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.828311 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.830153 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.830804 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.830807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.830809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.830903 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.831197 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.831199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.831200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.831375 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.831452 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.831916 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.832018 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:58:11.832978 10633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.818569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.67:37301)
0809 07:58:11.819068 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.819112 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.820209 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.820815 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.820823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.821243 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.821910 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.821925 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.822707 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.822710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.823659 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.823690 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.824397 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.824401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.824586 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.825268 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.825297 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.828096 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.830268 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.830274 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.830289 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.830670 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.830975 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.830977 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.830979 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.831106 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.831467 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.831471 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.831701 (+ 230us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.831858 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.832101 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":138,"threads_started":1}
I20260809 07:58:11.834237 10745 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45753
I20260809 07:58:11.834378 10745 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:11.834949 10745 heartbeater.cc:511] Master 127.8.51.126:45753 requested a full tablet report, sending...
I20260809 07:58:11.836083 10238 ts_manager.cc:194] Registered new tserver with Master: 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:11.836858 10238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:37301
I20260809 07:58:11.838140 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 10609
I20260809 07:58:11.838259 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:11.838560 8397 external_mini_cluster.cc:1428] Setting key ce2a88bde505e6ea2222dbc10431e769
I20260809 07:58:11.840758 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:58:11.844129 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.836637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:32811 (local address 127.8.51.126:45753)
0809 07:58:11.836765 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.836768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.836976 (+ 208us) server_negotiation.cc:407] Connection header received
0809 07:58:11.837124 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.837127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.837173 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.837246 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.837800 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.838527 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.839506 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.839722 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.839833 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.841031 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.841034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.841037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.841061 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.842462 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.842893 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.842897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.842898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.842978 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.843268 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.843271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.843272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.843466 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.843601 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.843871 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.843975 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:11.844144 10753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.836552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.8.51.67:32811)
0809 07:58:11.836893 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.836904 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.837021 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.837265 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.837267 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.837496 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:11.837692 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.837700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.838669 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.838672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.839393 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.839402 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.839835 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.839839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.839927 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.840451 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:11.840466 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:11.840907 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:11.842589 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.842593 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.842595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.842796 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.843072 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:11.843076 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:11.843078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:11.843168 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:11.843591 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:11.843594 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:11.843696 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.843814 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.843957 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":5,"thread_start_us":99,"threads_started":1}
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 07:58:11 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:11.867951 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.859855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44360 (local address 127.8.51.126:45753)
0809 07:58:11.859979 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.859982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.859993 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:11.860029 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.860031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.860066 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.860162 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:11.860874 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.861392 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.862286 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.862500 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.862633 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.865041 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:11.865044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:11.865046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:11.865070 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:11.866330 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.866745 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.866753 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.866754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.866827 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:11.867098 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:11.867102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:11.867103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:11.867285 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:11.867419 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.867648 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.867764 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:58:11.870800 10238 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:11.873950 10238 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:11.890283 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.883840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56838 (local address 127.8.51.67:37359)
0809 07:58:11.884365 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.884378 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.884405 (+ 27us) server_negotiation.cc:407] Connection header received
0809 07:58:11.884494 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.884499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.884727 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.884894 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:11.885412 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.886656 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.888559 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.889433 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.889567 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.889796 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.889982 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.890095 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":129,"threads_started":1}
I20260809 07:58:11.890316 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.882317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:37359 (local address 127.0.0.1:56838)
0809 07:58:11.882766 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.882827 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.882993 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.885103 (+ 2110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.885110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.885136 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:11.885277 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.885285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.886865 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.886882 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.888410 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.888421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.889566 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.889603 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.889751 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.889813 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.889936 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.890081 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":92,"threads_started":1}
I20260809 07:58:11.890535 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.883165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.0.0.1:46836)
0809 07:58:11.883453 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.883467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.883575 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.885838 (+ 2263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.885841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.885858 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:11.885952 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.885958 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.887351 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.887354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.888637 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.888649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.889948 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.889952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.890067 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.890091 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.890167 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.890252 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":114,"threads_started":1}
I20260809 07:58:11.890666 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.883875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46836 (local address 127.8.51.65:41783)
0809 07:58:11.885198 (+ 1323us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.885206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.885228 (+ 22us) server_negotiation.cc:407] Connection header received
0809 07:58:11.885301 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.885309 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.885519 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.885693 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:11.886091 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.887216 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.888774 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.889536 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.889734 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.889862 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.890386 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.890511 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1219,"thread_start_us":105,"threads_started":1}
I20260809 07:58:11.894194 10678 tablet_service.cc:1467] Processing CreateTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab (DEFAULT_TABLE table=test-table [id=c7132fd9e01141398700911078921108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:11.895397 10678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bc3e7407ab4f29ae5e7f0ded83afab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:11.895156 10384 tablet_service.cc:1467] Processing CreateTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab (DEFAULT_TABLE table=test-table [id=c7132fd9e01141398700911078921108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:11.896384 10766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.883175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33043 (local address 127.0.0.1:56730)
0809 07:58:11.883520 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:11.883531 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:11.883601 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:11.891667 (+ 8066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:11.891670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:11.891691 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:11.891771 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.891777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.893811 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.893814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.894924 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:11.894934 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.896043 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.896046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:11.896127 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.896151 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 07:58:11.896201 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 07:58:11.896264 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":123,"threads_started":1}
I20260809 07:58:11.897063 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:11.885749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56730 (local address 127.8.51.66:33043)
0809 07:58:11.891198 (+ 5449us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:11.891213 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:11.891238 (+ 25us) server_negotiation.cc:407] Connection header received
0809 07:58:11.891314 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:11.891319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:11.891512 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:11.891662 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:11.892576 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.893669 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.895116 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:11.895907 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:11.896645 (+ 738us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:11.896807 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:11.896855 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 07:58:11.896941 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5328,"thread_start_us":101,"threads_started":1}
I20260809 07:58:11.900298 10530 tablet_service.cc:1467] Processing CreateTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab (DEFAULT_TABLE table=test-table [id=c7132fd9e01141398700911078921108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:11.901405 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bc3e7407ab4f29ae5e7f0ded83afab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:11.903054 10384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bc3e7407ab4f29ae5e7f0ded83afab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:11.906507 10771 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Bootstrap starting.
I20260809 07:58:11.908542 10771 tablet_bootstrap.cc:654] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:11.909246 10771 log.cc:824] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:11.911305 10771 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: No bootstrap required, opened a new log
I20260809 07:58:11.911515 10771 ts_tablet_manager.cc:1397] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 07:58:11.913565 10773 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Bootstrap starting.
I20260809 07:58:11.914920 10771 raft_consensus.cc:348] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.915186 10771 raft_consensus.cc:374] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:11.915251 10771 raft_consensus.cc:729] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Initialized, Role: FOLLOWER
I20260809 07:58:11.915714 10771 consensus_queue.cc:260] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.916374 10745 heartbeater.cc:503] Master 127.8.51.126:45753 was elected leader, sending a full tablet report...
I20260809 07:58:11.916718 10771 ts_tablet_manager.cc:1428] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260809 07:58:11.917671 10773 tablet_bootstrap.cc:654] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:11.918563 10773 log.cc:824] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:11.920322 10777 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Bootstrap starting.
I20260809 07:58:11.923058 10777 tablet_bootstrap.cc:654] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:11.923095 10773 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: No bootstrap required, opened a new log
I20260809 07:58:11.923310 10773 ts_tablet_manager.cc:1397] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260809 07:58:11.923983 10777 log.cc:824] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:11.926438 10777 tablet_bootstrap.cc:492] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: No bootstrap required, opened a new log
I20260809 07:58:11.926656 10777 ts_tablet_manager.cc:1397] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 07:58:11.927233 10773 raft_consensus.cc:348] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.927474 10773 raft_consensus.cc:374] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:11.927536 10773 raft_consensus.cc:729] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Initialized, Role: FOLLOWER
I20260809 07:58:11.928002 10773 consensus_queue.cc:260] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.928808 10773 ts_tablet_manager.cc:1428] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent starting tablet: real 0.005s user 0.005s sys 0.002s
I20260809 07:58:11.929194 10452 heartbeater.cc:503] Master 127.8.51.126:45753 was elected leader, sending a full tablet report...
I20260809 07:58:11.932310 10777 raft_consensus.cc:348] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.932616 10777 raft_consensus.cc:374] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:11.932709 10777 raft_consensus.cc:729] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Initialized, Role: FOLLOWER
I20260809 07:58:11.933213 10777 consensus_queue.cc:260] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:11.933952 10598 heartbeater.cc:503] Master 127.8.51.126:45753 was elected leader, sending a full tablet report...
I20260809 07:58:11.934513 10777 ts_tablet_manager.cc:1428] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
W20260809 07:58:12.081092 10746 tablet.cc:2369] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:12.103675 10599 tablet.cc:2369] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:12.116178 10780 raft_consensus.cc:482] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:12.116396 10780 raft_consensus.cc:504] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:12.117479 10780 leader_election.cc:288] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359), a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783)
W20260809 07:58:12.119848 10453 tablet.cc:2369] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:12.122649 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.118305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:60131 (local address 127.8.51.65:41783)
0809 07:58:12.118456 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.118460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.118476 (+ 16us) server_negotiation.cc:407] Connection header received
0809 07:58:12.118525 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.118527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.118583 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.118648 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:12.118891 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.119621 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.121354 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.122026 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.122143 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.122205 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.122436 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.122516 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:12.122649 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.117863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53377 (local address 127.8.51.67:37359)
0809 07:58:12.118032 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.118039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.118213 (+ 174us) server_negotiation.cc:407] Connection header received
0809 07:58:12.118282 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.118285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.118366 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.118454 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:12.118773 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.119551 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.121354 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.122019 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.122143 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.122205 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.122436 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.122517 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 07:58:12.122743 10782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.117767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:37359 (local address 127.8.51.66:53377)
0809 07:58:12.118019 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.118032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.118147 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.118480 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.118486 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.118504 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:12.118665 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.118671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.119657 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.119659 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.121221 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.121232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.122155 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.122159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.122318 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.122334 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.122408 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.122531 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":203,"thread_start_us":80,"threads_started":1}
I20260809 07:58:12.122748 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.118163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.8.51.66:60131)
0809 07:58:12.118346 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.118357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.118455 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.118678 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.118680 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.118697 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:12.118791 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.118795 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.119711 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.119714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.121221 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.121232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.122155 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.122159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.122297 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.122327 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.122408 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.122531 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":207,"thread_start_us":56,"threads_started":1}
I20260809 07:58:12.123638 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bc3e7407ab4f29ae5e7f0ded83afab" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" is_pre_election: true
I20260809 07:58:12.123670 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bc3e7407ab4f29ae5e7f0ded83afab" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38" is_pre_election: true
I20260809 07:58:12.123909 10401 raft_consensus.cc:2454] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 0.
I20260809 07:58:12.123934 10698 raft_consensus.cc:2454] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 0.
I20260809 07:58:12.124361 10482 leader_election.cc:302] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, 345c09825d4045548c139db75e4b6b38; no voters:
I20260809 07:58:12.124625 10780 raft_consensus.cc:2781] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:12.124696 10780 raft_consensus.cc:482] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:12.124759 10780 raft_consensus.cc:3037] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.126026 10780 raft_consensus.cc:504] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:12.126402 10780 leader_election.cc:288] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 election: Requested vote from peers 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359), a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783)
I20260809 07:58:12.126796 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bc3e7407ab4f29ae5e7f0ded83afab" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38"
I20260809 07:58:12.126906 10698 raft_consensus.cc:3037] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.128168 10698 raft_consensus.cc:2454] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 1.
I20260809 07:58:12.128459 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bc3e7407ab4f29ae5e7f0ded83afab" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
I20260809 07:58:12.128494 10482 leader_election.cc:302] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, 345c09825d4045548c139db75e4b6b38; no voters:
I20260809 07:58:12.128593 10401 raft_consensus.cc:3037] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.128657 10780 raft_consensus.cc:2781] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:12.128856 10780 raft_consensus.cc:686] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 1 LEADER]: Becoming Leader. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Running, Role: LEADER
I20260809 07:58:12.129192 10780 consensus_queue.cc:237] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } }
I20260809 07:58:12.129803 10401 raft_consensus.cc:2454] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 1.
I20260809 07:58:12.132392 10237 catalog_manager.cc:5495] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "13fdd531a60e4262ab80ed5f237ab092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } health_report { overall_health: HEALTHY } } }
Aug 09 07:58:12 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262291, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:12.211411 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.203307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44376 (local address 127.8.51.126:45753)
0809 07:58:12.203476 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.203481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.203709 (+ 228us) server_negotiation.cc:407] Connection header received
0809 07:58:12.203845 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.203848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.203890 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.203979 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:12.204723 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.205272 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.206088 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.206367 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.206444 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.208638 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:12.208641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:12.208642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:12.208662 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:12.209901 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:12.210328 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:12.210331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:12.210332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:12.210400 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:12.210647 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:12.210649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:12.210650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:12.210828 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:12.210903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.211189 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.211280 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 07:58:12.211414 10792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.203253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45753 (local address 127.0.0.1:44376)
0809 07:58:12.203608 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.203622 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.203760 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.204016 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.204018 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.204432 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:12.204621 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.204629 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.205364 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.205367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.205988 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.205997 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.206461 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.206464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.206535 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.207121 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:12.207132 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:12.208519 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:12.209993 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:12.210001 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:12.210006 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:12.210244 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:12.210476 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:12.210478 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:12.210479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:12.210570 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:12.210919 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:12.210925 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:12.211023 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.211125 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.211234 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":169,"threads_started":1}
I20260809 07:58:12.215162 10237 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:44376:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 07:58:12.215807 10237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:12.220448 10384 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ee075ae0043c39a45e30cbc5efdeb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=307fe990e3404da284da2b8dbcfc3863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:12.220463 10530 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ee075ae0043c39a45e30cbc5efdeb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=307fe990e3404da284da2b8dbcfc3863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:12.220778 10678 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ee075ae0043c39a45e30cbc5efdeb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=307fe990e3404da284da2b8dbcfc3863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:12.221174 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ee075ae0043c39a45e30cbc5efdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.221189 10384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ee075ae0043c39a45e30cbc5efdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.221329 10678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ee075ae0043c39a45e30cbc5efdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.223676 10773 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: Bootstrap starting.
I20260809 07:58:12.224099 10771 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: Bootstrap starting.
I20260809 07:58:12.224750 10773 tablet_bootstrap.cc:654] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.225070 10771 tablet_bootstrap.cc:654] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.225706 10777 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: Bootstrap starting.
I20260809 07:58:12.226230 10771 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: No bootstrap required, opened a new log
I20260809 07:58:12.226230 10773 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: No bootstrap required, opened a new log
I20260809 07:58:12.226321 10773 ts_tablet_manager.cc:1397] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 07:58:12.226321 10771 ts_tablet_manager.cc:1397] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 07:58:12.226759 10771 raft_consensus.cc:348] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.226759 10773 raft_consensus.cc:348] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.226877 10771 raft_consensus.cc:374] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.226890 10773 raft_consensus.cc:374] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.226917 10771 raft_consensus.cc:729] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.226925 10773 raft_consensus.cc:729] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.227037 10777 tablet_bootstrap.cc:654] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.227042 10773 consensus_queue.cc:260] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.227056 10771 consensus_queue.cc:260] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.227319 10773 ts_tablet_manager.cc:1428] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:12.227316 10771 ts_tablet_manager.cc:1428] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260809 07:58:12.227532 10774 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.227669 10774 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.227591 10779 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.227749 10779 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.228365 10777 tablet_bootstrap.cc:492] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: No bootstrap required, opened a new log
I20260809 07:58:12.228466 10777 ts_tablet_manager.cc:1397] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:12.228902 10777 raft_consensus.cc:348] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.229033 10777 raft_consensus.cc:374] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.229091 10777 raft_consensus.cc:729] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.229231 10777 consensus_queue.cc:260] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.229547 10777 ts_tablet_manager.cc:1428] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:12.229511 10780 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.229650 10780 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.429296 10779 raft_consensus.cc:482] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:12.429436 10779 raft_consensus.cc:504] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.430629 10779 leader_election.cc:288] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:12.436127 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.431072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:53955 (local address 127.8.51.67:37359)
0809 07:58:12.431247 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.431254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.431434 (+ 180us) server_negotiation.cc:407] Connection header received
0809 07:58:12.431605 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.431610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.431677 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.431758 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:12.432105 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.432869 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.434779 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.435408 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.435523 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.435589 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.435934 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.436001 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:12.436131 10797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.431040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:46115 (local address 127.8.51.66:33043)
0809 07:58:12.431352 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.431366 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.431580 (+ 214us) server_negotiation.cc:407] Connection header received
0809 07:58:12.431690 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.431694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.431751 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.431829 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:12.432104 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.432869 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.434779 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.435435 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.435535 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.435590 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.435934 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.436004 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":84,"threads_started":1}
I20260809 07:58:12.436208 10798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.430953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33043 (local address 127.8.51.65:46115)
0809 07:58:12.431484 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.431498 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.431585 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.431845 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.431848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.431860 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:12.431986 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.431993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.433006 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.433008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.434648 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.434661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.435544 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.435548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.435762 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.435829 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.435906 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.436028 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":488,"thread_start_us":99,"threads_started":1}
I20260809 07:58:12.436605 10796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.430946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:37359 (local address 127.8.51.65:53955)
0809 07:58:12.431327 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.431344 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.431472 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.431776 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.431778 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.431793 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:12.431986 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.431993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.432991 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.432997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.434648 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.434661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.435544 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.435548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.435758 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.435829 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.435906 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.436028 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":246,"thread_start_us":74,"threads_started":1}
I20260809 07:58:12.436806 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ee075ae0043c39a45e30cbc5efdeb" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092" is_pre_election: true
I20260809 07:58:12.437100 10551 raft_consensus.cc:2454] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 0.
I20260809 07:58:12.437115 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ee075ae0043c39a45e30cbc5efdeb" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38" is_pre_election: true
I20260809 07:58:12.437295 10698 raft_consensus.cc:2454] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 0.
I20260809 07:58:12.437681 10333 leader_election.cc:302] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, a6c1ff5b4d5a4426a95576b3cbf7446d; no voters:
I20260809 07:58:12.437964 10779 raft_consensus.cc:2781] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:12.438025 10779 raft_consensus.cc:482] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:12.438071 10779 raft_consensus.cc:3037] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.439325 10779 raft_consensus.cc:504] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.439615 10779 leader_election.cc:288] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 election: Requested vote from peers 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:12.439961 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ee075ae0043c39a45e30cbc5efdeb" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092"
I20260809 07:58:12.439961 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ee075ae0043c39a45e30cbc5efdeb" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38"
I20260809 07:58:12.440073 10551 raft_consensus.cc:3037] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.440073 10698 raft_consensus.cc:3037] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.441181 10551 raft_consensus.cc:2454] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 1.
I20260809 07:58:12.441183 10698 raft_consensus.cc:2454] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 1.
I20260809 07:58:12.441483 10335 leader_election.cc:302] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 345c09825d4045548c139db75e4b6b38, a6c1ff5b4d5a4426a95576b3cbf7446d; no voters:
I20260809 07:58:12.441720 10779 raft_consensus.cc:2781] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:12.441916 10779 raft_consensus.cc:686] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 LEADER]: Becoming Leader. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Running, Role: LEADER
I20260809 07:58:12.442199 10779 consensus_queue.cc:237] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.444320 10799 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: TxnStatusTablet state changed. Reason: New leader a6c1ff5b4d5a4426a95576b3cbf7446d. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.444489 10799 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:12.444830 10801 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 07:58:12.445036 10801 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 07:58:12.445434 10238 catalog_manager.cc:5495] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d reported cstate change: term changed from 0 to 1, leader changed from <none> to a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65). New cstate: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:12.467299 10792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.463488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.0.0.1:46842)
0809 07:58:12.463724 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.463739 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.463849 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.464233 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.464236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.464246 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:12.464348 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.464354 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.465071 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.465075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.465756 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.465766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.466214 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.466217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.466310 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.466367 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.467006 (+ 639us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.467022 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.467094 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.467185 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260809 07:58:12.467315 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.463578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46842 (local address 127.8.51.65:41783)
0809 07:58:12.463707 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.463712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.463788 (+ 76us) server_negotiation.cc:407] Connection header received
0809 07:58:12.464016 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.464019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.464108 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.464214 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.464464 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.464952 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.465874 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.466086 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.466194 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.466523 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.466899 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.467024 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.467104 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.467157 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 07:58:12.473141 10551 raft_consensus.cc:1261] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Refusing update from remote peer a6c1ff5b4d5a4426a95576b3cbf7446d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.473177 10698 raft_consensus.cc:1261] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Refusing update from remote peer a6c1ff5b4d5a4426a95576b3cbf7446d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.473778 10799 consensus_queue.cc:1035] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Connected to new peer: Peer: permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:12.474186 10799 consensus_queue.cc:1035] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Connected to new peer: Peer: permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:12.477064 10780 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: TxnStatusTablet state changed. Reason: New leader a6c1ff5b4d5a4426a95576b3cbf7446d. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.477197 10780 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.477782 10774 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: TxnStatusTablet state changed. Reason: New leader a6c1ff5b4d5a4426a95576b3cbf7446d. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.477903 10774 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.481438 10805 mvcc.cc:205] Tried to move back new op lower bound from 7316530349963214848 to 7316530349845463040. Current Snapshot: MvccSnapshot[applied={T|T < 7316530349963214848}]
I20260809 07:58:12.482177 10779 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.482275 10779 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:12.482347 10799 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.482426 10799 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P a6c1ff5b4d5a4426a95576b3cbf7446d: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:12.483409 10780 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.483506 10780 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 13fdd531a60e4262ab80ed5f237ab092: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.485322 10774 tablet_replica.cc:439] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } } }
I20260809 07:58:12.485427 10774 tablet_replica.cc:442] T 8d4ee075ae0043c39a45e30cbc5efdeb P 345c09825d4045548c139db75e4b6b38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:12.486928 10806 mvcc.cc:205] Tried to move back new op lower bound from 7316530349963214848 to 7316530349845463040. Current Snapshot: MvccSnapshot[applied={T|T < 7316530349963214848}]
I20260809 07:58:12.492923 10797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.487742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.8.51.66:33043)
0809 07:58:12.487856 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.487860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.489025 (+ 1165us) server_negotiation.cc:407] Connection header received
0809 07:58:12.489167 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.489169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.489213 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.489289 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.489541 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.490189 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.491405 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.491778 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.491883 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.492127 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.492585 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.492695 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.492749 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.492803 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 07:58:12.503491 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.500088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55461 (local address 127.8.51.65:41783)
0809 07:58:12.500222 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.500227 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.500466 (+ 239us) server_negotiation.cc:407] Connection header received
0809 07:58:12.500649 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.500651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.500708 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.500811 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.501070 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.501552 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.502469 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.502683 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.502788 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.503081 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.503150 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.503228 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.503316 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.503363 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:12.503526 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.499986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.8.51.66:55461)
0809 07:58:12.500371 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.500383 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.500545 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.500822 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.500825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.500832 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:12.500963 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.500968 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.501691 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.501697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.502344 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.502353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.502790 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.502794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.502886 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.502932 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.503235 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.503245 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.503306 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.503380 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":118,"threads_started":1}
I20260809 07:58:12.510118 10698 raft_consensus.cc:1261] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Refusing update from remote peer 13fdd531a60e4262ab80ed5f237ab092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.510262 10401 raft_consensus.cc:1261] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Refusing update from remote peer 13fdd531a60e4262ab80ed5f237ab092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.510588 10780 consensus_queue.cc:1035] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:12.510784 10784 consensus_queue.cc:1035] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:12.517753 10807 mvcc.cc:205] Tried to move back new op lower bound from 7316530350116712448 to 7316530348564320256. Current Snapshot: MvccSnapshot[applied={T|T < 7316530350116712448}]
I20260809 07:58:12.534723 10797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.531286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:55343 (local address 127.8.51.66:33043)
0809 07:58:12.531424 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.531429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.531469 (+ 40us) server_negotiation.cc:407] Connection header received
0809 07:58:12.531515 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.531518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.531564 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.531640 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.531945 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.532447 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.533498 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.533817 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.533952 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.534246 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.534326 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.534412 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.534500 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.534571 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:58:12.534758 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.530971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33043 (local address 127.8.51.65:55343)
0809 07:58:12.531302 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.531320 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.531417 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.531645 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.531646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.531651 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:12.531792 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.531799 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.532558 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.532563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.533380 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.533390 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.533971 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.533975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.534070 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.534112 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.534417 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.534425 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.534489 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.534575 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":129,"threads_started":1}
I20260809 07:58:12.559826 10237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:12.560017 10237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:12.562831 10237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Sending DeleteTablet for 3 replicas of tablet 96bc3e7407ab4f29ae5e7f0ded83afab
I20260809 07:58:12.563576 10384 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46836
I20260809 07:58:12.564126 10827 tablet_replica.cc:330] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: stopping tablet replica
I20260809 07:58:12.564456 10827 raft_consensus.cc:2229] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:12.564632 10827 raft_consensus.cc:2258] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:12.564837 10530 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56730
I20260809 07:58:12.566061 10237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 07:58:12.566187 10678 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bc3e7407ab4f29ae5e7f0ded83afab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56838
W20260809 07:58:12.566471 10237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:12.566895 10828 tablet_replica.cc:330] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: stopping tablet replica
I20260809 07:58:12.567147 10829 tablet_replica.cc:330] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: stopping tablet replica
I20260809 07:58:12.567516 10829 raft_consensus.cc:2229] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:12.567821 10828 raft_consensus.cc:2229] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:12.568233 10828 raft_consensus.cc:2258] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:12.568480 10829 raft_consensus.cc:2258] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:12.570045 10829 ts_tablet_manager.cc:1905] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:12.571645 10384 tablet_service.cc:1467] Processing CreateTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 (DEFAULT_TABLE table=test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:12.571938 10384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d7381f382b47f99ae5f2ca691cf7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.572155 10827 ts_tablet_manager.cc:1905] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:12.574015 10530 tablet_service.cc:1467] Processing CreateTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 (DEFAULT_TABLE table=test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:12.574283 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d7381f382b47f99ae5f2ca691cf7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.576521 10827 ts_tablet_manager.cc:1918] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:12.576606 10827 log.cc:1196] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/96bc3e7407ab4f29ae5e7f0ded83afab
I20260809 07:58:12.576920 10827 ts_tablet_manager.cc:1939] T 96bc3e7407ab4f29ae5e7f0ded83afab P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting consensus metadata
I20260809 07:58:12.577044 10777 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Bootstrap starting.
I20260809 07:58:12.578042 10777 tablet_bootstrap.cc:654] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.579200 10223 catalog_manager.cc:4841] TS a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783): tablet 96bc3e7407ab4f29ae5e7f0ded83afab (table test-table [id=c7132fd9e01141398700911078921108]) successfully deleted
I20260809 07:58:12.579346 10777 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: No bootstrap required, opened a new log
I20260809 07:58:12.579435 10777 ts_tablet_manager.cc:1397] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:12.579905 10777 raft_consensus.cc:348] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.580020 10777 raft_consensus.cc:374] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.580057 10777 raft_consensus.cc:729] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.580199 10777 consensus_queue.cc:260] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.580461 10777 ts_tablet_manager.cc:1428] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:12.580921 10773 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Bootstrap starting.
I20260809 07:58:12.581038 10828 ts_tablet_manager.cc:1905] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:12.582350 10678 tablet_service.cc:1467] Processing CreateTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 (DEFAULT_TABLE table=test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:12.582643 10678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d7381f382b47f99ae5f2ca691cf7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:12.585021 10828 ts_tablet_manager.cc:1918] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:12.585106 10771 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Bootstrap starting.
I20260809 07:58:12.586097 10771 tablet_bootstrap.cc:654] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.587867 10773 tablet_bootstrap.cc:654] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:12.588325 10829 ts_tablet_manager.cc:1918] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:12.588459 10828 log.cc:1196] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/96bc3e7407ab4f29ae5e7f0ded83afab
I20260809 07:58:12.588549 10829 log.cc:1196] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/96bc3e7407ab4f29ae5e7f0ded83afab
I20260809 07:58:12.588928 10828 ts_tablet_manager.cc:1939] T 96bc3e7407ab4f29ae5e7f0ded83afab P 13fdd531a60e4262ab80ed5f237ab092: Deleting consensus metadata
I20260809 07:58:12.589262 10829 ts_tablet_manager.cc:1939] T 96bc3e7407ab4f29ae5e7f0ded83afab P 345c09825d4045548c139db75e4b6b38: Deleting consensus metadata
I20260809 07:58:12.589305 10773 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: No bootstrap required, opened a new log
I20260809 07:58:12.589402 10773 ts_tablet_manager.cc:1397] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260809 07:58:12.589886 10773 raft_consensus.cc:348] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.590023 10773 raft_consensus.cc:374] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.590061 10773 raft_consensus.cc:729] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.590205 10773 consensus_queue.cc:260] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.590474 10773 ts_tablet_manager.cc:1428] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:12.592034 10223 catalog_manager.cc:4841] TS 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359): tablet 96bc3e7407ab4f29ae5e7f0ded83afab (table test-table [id=c7132fd9e01141398700911078921108]) successfully deleted
I20260809 07:58:12.592741 10221 catalog_manager.cc:4841] TS 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043): tablet 96bc3e7407ab4f29ae5e7f0ded83afab (table test-table [id=c7132fd9e01141398700911078921108]) successfully deleted
I20260809 07:58:12.593653 10771 tablet_bootstrap.cc:492] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: No bootstrap required, opened a new log
I20260809 07:58:12.593748 10771 ts_tablet_manager.cc:1397] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260809 07:58:12.594221 10771 raft_consensus.cc:348] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.594348 10771 raft_consensus.cc:374] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:12.594385 10771 raft_consensus.cc:729] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Initialized, Role: FOLLOWER
I20260809 07:58:12.594516 10771 consensus_queue.cc:260] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.594826 10771 ts_tablet_manager.cc:1428] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:12.645411 10811 raft_consensus.cc:482] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:12.645541 10811 raft_consensus.cc:504] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.646046 10811 leader_election.cc:288] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:12.646485 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d7381f382b47f99ae5f2ca691cf7c1" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38" is_pre_election: true
I20260809 07:58:12.646494 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d7381f382b47f99ae5f2ca691cf7c1" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092" is_pre_election: true
I20260809 07:58:12.646643 10698 raft_consensus.cc:2454] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 0.
I20260809 07:58:12.646643 10551 raft_consensus.cc:2454] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 0.
I20260809 07:58:12.646950 10333 leader_election.cc:302] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, a6c1ff5b4d5a4426a95576b3cbf7446d; no voters:
I20260809 07:58:12.647133 10811 raft_consensus.cc:2781] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:12.647199 10811 raft_consensus.cc:482] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:12.647260 10811 raft_consensus.cc:3037] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.648274 10811 raft_consensus.cc:504] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.648639 10811 leader_election.cc:288] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 election: Requested vote from peers 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:12.648957 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d7381f382b47f99ae5f2ca691cf7c1" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092"
I20260809 07:58:12.648986 10698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d7381f382b47f99ae5f2ca691cf7c1" candidate_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38"
I20260809 07:58:12.649091 10551 raft_consensus.cc:3037] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.649116 10698 raft_consensus.cc:3037] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:12.650131 10698 raft_consensus.cc:2454] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 1.
I20260809 07:58:12.650321 10551 raft_consensus.cc:2454] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6c1ff5b4d5a4426a95576b3cbf7446d in term 1.
I20260809 07:58:12.650437 10335 leader_election.cc:302] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 345c09825d4045548c139db75e4b6b38, a6c1ff5b4d5a4426a95576b3cbf7446d; no voters:
I20260809 07:58:12.650676 10811 raft_consensus.cc:2781] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:12.650807 10811 raft_consensus.cc:686] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 LEADER]: Becoming Leader. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Running, Role: LEADER
I20260809 07:58:12.650971 10811 consensus_queue.cc:237] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:12.652920 10237 catalog_manager.cc:5495] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d reported cstate change: term changed from 0 to 1, leader changed from <none> to a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65). New cstate: current_term: 1 leader_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:12.684911 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.681803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46848 (local address 127.8.51.65:41783)
0809 07:58:12.681906 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.681912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.681955 (+ 43us) server_negotiation.cc:407] Connection header received
0809 07:58:12.682129 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.682132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.682179 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.682264 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.682518 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.683031 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.683878 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.684114 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.684222 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.684478 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.684556 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.684637 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.684726 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.684777 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:12.694404 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.690976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:60135 (local address 127.8.51.65:41783)
0809 07:58:12.691095 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:12.691099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:12.691159 (+ 60us) server_negotiation.cc:407] Connection header received
0809 07:58:12.691295 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:12.691297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:12.691332 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:12.691391 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:12.691645 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.692103 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.693257 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.693459 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.693553 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.693865 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.693929 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.693988 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:12.694131 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 07:58:12.694185 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":37}
I20260809 07:58:12.694427 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:12.690906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.8.51.65:60135)
0809 07:58:12.691097 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:12.691112 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:12.691207 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:12.691423 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:12.691426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:12.691434 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:12.691533 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.691539 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.692217 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.692221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.693116 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:12.693127 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:12.693620 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:12.693624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:12.693714 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:12.693747 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:12.694026 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:12.694034 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 07:58:12.694125 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 07:58:12.694236 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":16}
I20260809 07:58:12.700486 10698 raft_consensus.cc:1261] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Refusing update from remote peer a6c1ff5b4d5a4426a95576b3cbf7446d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.700652 10551 raft_consensus.cc:1261] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Refusing update from remote peer a6c1ff5b4d5a4426a95576b3cbf7446d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:12.701089 10811 consensus_queue.cc:1035] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Connected to new peer: Peer: permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:12.701277 10799 consensus_queue.cc:1035] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [LEADER]: Connected to new peer: Peer: permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 07:58:12.718429 10805 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 07:58:14.274207 10237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:14.274363 10237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:14.276751 10237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Sending DeleteTablet for 3 replicas of tablet 97d7381f382b47f99ae5f2ca691cf7c1
I20260809 07:58:14.277318 10383 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46836
I20260809 07:58:14.277354 10530 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56730
I20260809 07:58:14.277383 10678 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d7381f382b47f99ae5f2ca691cf7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56838
I20260809 07:58:14.277724 10860 tablet_replica.cc:330] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: stopping tablet replica
I20260809 07:58:14.277716 10859 tablet_replica.cc:330] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: stopping tablet replica
I20260809 07:58:14.277842 10860 raft_consensus.cc:2229] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:14.277968 10860 raft_consensus.cc:2258] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.277984 10859 raft_consensus.cc:2229] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:14.277987 10861 tablet_replica.cc:330] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: stopping tablet replica
I20260809 07:58:14.278234 10861 raft_consensus.cc:2229] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:14.278318 10859 raft_consensus.cc:2258] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.278443 10861 raft_consensus.cc:2258] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.278726 10860 ts_tablet_manager.cc:1905] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.278905 10859 ts_tablet_manager.cc:1905] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.281607 10859 ts_tablet_manager.cc:1918] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 07:58:14.281601 10860 ts_tablet_manager.cc:1918] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 07:58:14.281692 10860 log.cc:1196] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/97d7381f382b47f99ae5f2ca691cf7c1
I20260809 07:58:14.281692 10859 log.cc:1196] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/97d7381f382b47f99ae5f2ca691cf7c1
I20260809 07:58:14.281810 10861 ts_tablet_manager.cc:1905] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.281989 10860 ts_tablet_manager.cc:1939] T 97d7381f382b47f99ae5f2ca691cf7c1 P 13fdd531a60e4262ab80ed5f237ab092: Deleting consensus metadata
I20260809 07:58:14.281999 10859 ts_tablet_manager.cc:1939] T 97d7381f382b47f99ae5f2ca691cf7c1 P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting consensus metadata
I20260809 07:58:14.282862 10223 catalog_manager.cc:4841] TS a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783): tablet 97d7381f382b47f99ae5f2ca691cf7c1 (table test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]) successfully deleted
I20260809 07:58:14.282862 10221 catalog_manager.cc:4841] TS 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043): tablet 97d7381f382b47f99ae5f2ca691cf7c1 (table test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]) successfully deleted
I20260809 07:58:14.285108 10861 ts_tablet_manager.cc:1918] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 07:58:14.285204 10861 log.cc:1196] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/97d7381f382b47f99ae5f2ca691cf7c1
I20260809 07:58:14.285499 10861 ts_tablet_manager.cc:1939] T 97d7381f382b47f99ae5f2ca691cf7c1 P 345c09825d4045548c139db75e4b6b38: Deleting consensus metadata
I20260809 07:58:14.286304 10223 catalog_manager.cc:4841] TS 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359): tablet 97d7381f382b47f99ae5f2ca691cf7c1 (table test-table [id=00e61b8f42414b0ba0bdfb0566b483dd]) successfully deleted
Aug 09 07:58:14 dist-test-slave-njxd krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262294, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 07:58:14 dist-test-slave-njxd krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262294, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:14.308415 10869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.299400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44378 (local address 127.8.51.126:45753)
0809 07:58:14.299723 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.299732 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.299748 (+ 16us) server_negotiation.cc:407] Connection header received
0809 07:58:14.299892 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.299895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.299947 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.300045 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:14.300781 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.301356 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.302304 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.302551 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.302679 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.305126 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:14.305129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:14.305131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:14.305154 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:14.306716 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:14.307139 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:14.307142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:14.307144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:14.307254 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:14.307534 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:14.307538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:14.307539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:14.307728 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:14.307869 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.308105 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.308232 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":94,"threads_started":1}
I20260809 07:58:14.310910 10237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:14.311383 10237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:14.316125 10383 tablet_service.cc:1467] Processing CreateTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed (DEFAULT_TABLE table=test-table [id=b8eb227cf8af4308be50c5995971244e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.316169 10530 tablet_service.cc:1467] Processing CreateTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed (DEFAULT_TABLE table=test-table [id=b8eb227cf8af4308be50c5995971244e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.316476 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03db7a4389ec4b50824b4cb97125d1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.316476 10383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03db7a4389ec4b50824b4cb97125d1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.316444 10678 tablet_service.cc:1467] Processing CreateTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed (DEFAULT_TABLE table=test-table [id=b8eb227cf8af4308be50c5995971244e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.316711 10678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03db7a4389ec4b50824b4cb97125d1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.319182 10871 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Bootstrap starting.
I20260809 07:58:14.319408 10870 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Bootstrap starting.
I20260809 07:58:14.320058 10871 tablet_bootstrap.cc:654] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.320142 10870 tablet_bootstrap.cc:654] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.320704 10872 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Bootstrap starting.
I20260809 07:58:14.321300 10871 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: No bootstrap required, opened a new log
I20260809 07:58:14.321347 10870 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: No bootstrap required, opened a new log
I20260809 07:58:14.321432 10870 ts_tablet_manager.cc:1397] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:14.321619 10871 ts_tablet_manager.cc:1397] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:14.321892 10872 tablet_bootstrap.cc:654] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.321892 10870 raft_consensus.cc:348] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.322021 10870 raft_consensus.cc:374] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.322064 10870 raft_consensus.cc:729] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.322093 10871 raft_consensus.cc:348] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.322209 10871 raft_consensus.cc:374] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.322250 10871 raft_consensus.cc:729] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.322250 10870 consensus_queue.cc:260] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.322389 10871 consensus_queue.cc:260] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.322579 10870 ts_tablet_manager.cc:1428] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:14.322774 10871 ts_tablet_manager.cc:1428] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:14.323568 10872 tablet_bootstrap.cc:492] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: No bootstrap required, opened a new log
I20260809 07:58:14.323686 10872 ts_tablet_manager.cc:1397] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:14.324155 10872 raft_consensus.cc:348] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.324539 10872 raft_consensus.cc:374] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.324581 10872 raft_consensus.cc:729] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.324714 10872 consensus_queue.cc:260] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.325150 10872 ts_tablet_manager.cc:1428] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 07:58:14.430371 10877 raft_consensus.cc:482] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:14.430544 10877 raft_consensus.cc:504] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.431734 10877 leader_election.cc:288] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783), 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043)
I20260809 07:58:14.436308 10881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.431990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33043 (local address 127.8.51.67:56713)
0809 07:58:14.432681 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:14.432693 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:14.432819 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:14.433107 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:14.433110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:14.433127 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:14.433253 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.433259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.434041 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.434045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.434942 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.434952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.435834 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.435839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.435947 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.435989 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 07:58:14.436060 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 07:58:14.436135 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":299,"thread_start_us":100,"threads_started":1}
I20260809 07:58:14.436564 10879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.431990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.8.51.67:34327)
0809 07:58:14.432471 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:14.432491 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:14.432635 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:14.432901 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:14.432905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:14.432921 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:14.433066 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.433072 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.433899 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.433904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.434887 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.434896 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.436098 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.436104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.436207 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.436238 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 07:58:14.436301 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 07:58:14.436366 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":2,"thread_start_us":176,"threads_started":1}
I20260809 07:58:14.436702 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.432084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:34327 (local address 127.8.51.65:41783)
0809 07:58:14.432462 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.432472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.432620 (+ 148us) server_negotiation.cc:407] Connection header received
0809 07:58:14.432738 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.432741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.432794 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.432889 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:14.433186 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.433791 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.435345 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.435921 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.436030 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.436099 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.436364 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.436573 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":113,"threads_started":1}
I20260809 07:58:14.436698 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.432104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:56713 (local address 127.8.51.66:33043)
0809 07:58:14.432422 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.432432 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.432780 (+ 348us) server_negotiation.cc:407] Connection header received
0809 07:58:14.432941 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.432944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.432993 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.433093 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:14.433385 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.433921 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.435126 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.435696 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.435809 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.435878 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.436489 (+ 611us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.436571 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":112,"threads_started":1}
I20260809 07:58:14.437065 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03db7a4389ec4b50824b4cb97125d1ed" candidate_uuid: "345c09825d4045548c139db75e4b6b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092" is_pre_election: true
I20260809 07:58:14.437089 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03db7a4389ec4b50824b4cb97125d1ed" candidate_uuid: "345c09825d4045548c139db75e4b6b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" is_pre_election: true
I20260809 07:58:14.437211 10401 raft_consensus.cc:2454] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 345c09825d4045548c139db75e4b6b38 in term 0.
I20260809 07:58:14.437239 10551 raft_consensus.cc:2454] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 345c09825d4045548c139db75e4b6b38 in term 0.
I20260809 07:58:14.437668 10625 leader_election.cc:302] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, 345c09825d4045548c139db75e4b6b38; no voters:
I20260809 07:58:14.437955 10877 raft_consensus.cc:2781] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:14.438016 10877 raft_consensus.cc:482] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:14.438054 10877 raft_consensus.cc:3037] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.439196 10877 raft_consensus.cc:504] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.439509 10877 leader_election.cc:288] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [CANDIDATE]: Term 1 election: Requested vote from peers a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783), 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043)
I20260809 07:58:14.439831 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03db7a4389ec4b50824b4cb97125d1ed" candidate_uuid: "345c09825d4045548c139db75e4b6b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
I20260809 07:58:14.439831 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03db7a4389ec4b50824b4cb97125d1ed" candidate_uuid: "345c09825d4045548c139db75e4b6b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13fdd531a60e4262ab80ed5f237ab092"
I20260809 07:58:14.439949 10401 raft_consensus.cc:3037] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.439949 10551 raft_consensus.cc:3037] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.441066 10401 raft_consensus.cc:2454] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 345c09825d4045548c139db75e4b6b38 in term 1.
I20260809 07:58:14.441066 10551 raft_consensus.cc:2454] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 345c09825d4045548c139db75e4b6b38 in term 1.
I20260809 07:58:14.441406 10627 leader_election.cc:302] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 345c09825d4045548c139db75e4b6b38, a6c1ff5b4d5a4426a95576b3cbf7446d; no voters:
I20260809 07:58:14.441615 10877 raft_consensus.cc:2781] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:14.441835 10877 raft_consensus.cc:686] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 1 LEADER]: Becoming Leader. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Running, Role: LEADER
I20260809 07:58:14.442090 10877 consensus_queue.cc:237] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.444558 10237 catalog_manager.cc:5495] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 345c09825d4045548c139db75e4b6b38 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "345c09825d4045548c139db75e4b6b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } health_report { overall_health: HEALTHY } } }
I20260809 07:58:14.478134 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.474675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.8.51.67:37359)
0809 07:58:14.474933 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.474940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.474951 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:14.475018 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.475020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.475071 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.475185 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:14.475369 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.475893 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.476701 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.476928 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.477000 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.477230 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.477745 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.477834 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.477901 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.477944 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":112,"threads_started":1}
I20260809 07:58:14.487762 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.484585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:58917 (local address 127.8.51.65:41783)
0809 07:58:14.484715 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.484720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.484734 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:14.484883 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.484887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.484930 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.485005 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:14.485279 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.485816 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.486735 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.486943 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.487049 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.487344 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.487410 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.487487 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.487572 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.487622 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 07:58:14.487775 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.484373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.8.51.67:58917)
0809 07:58:14.484658 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:14.484674 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:14.484766 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:14.485025 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:14.485028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:14.485035 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:14.485174 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.485179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.485920 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.485925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.486614 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.486623 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.487051 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.487054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.487147 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.487191 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.487491 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.487499 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 07:58:14.487562 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 07:58:14.487635 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":109,"threads_started":1}
I20260809 07:58:14.493692 10401 raft_consensus.cc:1261] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Refusing update from remote peer 345c09825d4045548c139db75e4b6b38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:14.493703 10551 raft_consensus.cc:1261] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Refusing update from remote peer 345c09825d4045548c139db75e4b6b38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:14.494174 10877 consensus_queue.cc:1035] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:14.494354 10882 consensus_queue.cc:1035] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:14.510767 10892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.507513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:37359 (local address 127.8.51.65:53231)
0809 07:58:14.507874 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:14.507887 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:14.507973 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:14.508139 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:14.508141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:14.508146 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:14.508226 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.508230 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.508861 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.508863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.509640 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:14.509651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.510055 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.510058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:14.510156 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.510182 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.510477 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.510486 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 07:58:14.510551 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 07:58:14.510629 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":106,"threads_started":1}
I20260809 07:58:14.510752 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.507551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:53231 (local address 127.8.51.67:37359)
0809 07:58:14.507676 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.507680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.507939 (+ 259us) server_negotiation.cc:407] Connection header received
0809 07:58:14.508037 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.508039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.508078 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.508135 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:14.508291 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.508772 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.509743 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.509953 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.510032 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.510300 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.510380 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.510466 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.510561 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.510610 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 07:58:14.532647 10237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:14.532809 10237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:14.535012 10237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Sending DeleteTablet for 3 replicas of tablet 03db7a4389ec4b50824b4cb97125d1ed
I20260809 07:58:14.535702 10530 tablet_service.cc:1514] Processing DeleteTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56730
I20260809 07:58:14.535692 10678 tablet_service.cc:1514] Processing DeleteTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56838
I20260809 07:58:14.535825 10383 tablet_service.cc:1514] Processing DeleteTablet for tablet 03db7a4389ec4b50824b4cb97125d1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:14 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46836
I20260809 07:58:14.535884 10861 tablet_replica.cc:330] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: stopping tablet replica
I20260809 07:58:14.536005 10861 raft_consensus.cc:2229] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:14.536043 10859 tablet_replica.cc:330] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: stopping tablet replica
I20260809 07:58:14.536144 10859 raft_consensus.cc:2229] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:14.536278 10859 raft_consensus.cc:2258] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.536298 10861 raft_consensus.cc:2258] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.536418 10860 tablet_replica.cc:330] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: stopping tablet replica
I20260809 07:58:14.536554 10860 raft_consensus.cc:2229] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:14.536684 10860 raft_consensus.cc:2258] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:14.537020 10859 ts_tablet_manager.cc:1905] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.537045 10861 ts_tablet_manager.cc:1905] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.537707 10237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:14.538371 10237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:14.539635 10859 ts_tablet_manager.cc:1918] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:14.539635 10861 ts_tablet_manager.cc:1918] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:14.539716 10859 log.cc:1196] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/03db7a4389ec4b50824b4cb97125d1ed
I20260809 07:58:14.539716 10861 log.cc:1196] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/03db7a4389ec4b50824b4cb97125d1ed
I20260809 07:58:14.539986 10859 ts_tablet_manager.cc:1939] T 03db7a4389ec4b50824b4cb97125d1ed P a6c1ff5b4d5a4426a95576b3cbf7446d: Deleting consensus metadata
I20260809 07:58:14.540670 10223 catalog_manager.cc:4841] TS a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783): tablet 03db7a4389ec4b50824b4cb97125d1ed (table test-table [id=b8eb227cf8af4308be50c5995971244e]) successfully deleted
I20260809 07:58:14.541002 10861 ts_tablet_manager.cc:1939] T 03db7a4389ec4b50824b4cb97125d1ed P 345c09825d4045548c139db75e4b6b38: Deleting consensus metadata
I20260809 07:58:14.541675 10223 catalog_manager.cc:4841] TS 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359): tablet 03db7a4389ec4b50824b4cb97125d1ed (table test-table [id=b8eb227cf8af4308be50c5995971244e]) successfully deleted
I20260809 07:58:14.542876 10860 ts_tablet_manager.cc:1905] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:14.543690 10530 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b (DEFAULT_TABLE table=test-table [id=65735603a20c407e933312456a23cf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.543943 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3ef7e142fe461aac265d9b77d32f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.545424 10860 ts_tablet_manager.cc:1918] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:14.545501 10860 log.cc:1196] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/03db7a4389ec4b50824b4cb97125d1ed
I20260809 07:58:14.545995 10383 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b (DEFAULT_TABLE table=test-table [id=65735603a20c407e933312456a23cf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.546254 10871 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Bootstrap starting.
I20260809 07:58:14.546276 10383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3ef7e142fe461aac265d9b77d32f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.546808 10678 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b (DEFAULT_TABLE table=test-table [id=65735603a20c407e933312456a23cf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:14.547041 10678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3ef7e142fe461aac265d9b77d32f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:14.547168 10871 tablet_bootstrap.cc:654] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.548727 10870 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: Bootstrap starting.
I20260809 07:58:14.548885 10871 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: No bootstrap required, opened a new log
I20260809 07:58:14.548962 10871 ts_tablet_manager.cc:1397] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:14.549135 10860 ts_tablet_manager.cc:1939] T 03db7a4389ec4b50824b4cb97125d1ed P 13fdd531a60e4262ab80ed5f237ab092: Deleting consensus metadata
I20260809 07:58:14.549425 10872 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Bootstrap starting.
I20260809 07:58:14.549363 10871 raft_consensus.cc:348] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.549479 10871 raft_consensus.cc:374] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.549518 10871 raft_consensus.cc:729] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.549661 10870 tablet_bootstrap.cc:654] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.549702 10871 consensus_queue.cc:260] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.549873 10221 catalog_manager.cc:4841] TS 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043): tablet 03db7a4389ec4b50824b4cb97125d1ed (table test-table [id=b8eb227cf8af4308be50c5995971244e]) successfully deleted
I20260809 07:58:14.550014 10871 ts_tablet_manager.cc:1428] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:14.550451 10872 tablet_bootstrap.cc:654] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:14.551337 10870 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: No bootstrap required, opened a new log
I20260809 07:58:14.551434 10870 ts_tablet_manager.cc:1397] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 07:58:14.551779 10870 raft_consensus.cc:348] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.551901 10870 raft_consensus.cc:374] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.551942 10870 raft_consensus.cc:729] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c1ff5b4d5a4426a95576b3cbf7446d, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.552085 10870 consensus_queue.cc:260] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.552358 10870 ts_tablet_manager.cc:1428] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:14.552884 10872 tablet_bootstrap.cc:492] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: No bootstrap required, opened a new log
I20260809 07:58:14.552959 10872 ts_tablet_manager.cc:1397] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 07:58:14.553397 10872 raft_consensus.cc:348] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.553509 10872 raft_consensus.cc:374] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:14.553546 10872 raft_consensus.cc:729] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345c09825d4045548c139db75e4b6b38, State: Initialized, Role: FOLLOWER
I20260809 07:58:14.553690 10872 consensus_queue.cc:260] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.553930 10872 ts_tablet_manager.cc:1428] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:14.745124 10876 raft_consensus.cc:482] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:14.745297 10876 raft_consensus.cc:504] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.745843 10876 leader_election.cc:288] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:14.746368 10697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3ef7e142fe461aac265d9b77d32f9b" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38" is_pre_election: true
I20260809 07:58:14.746367 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3ef7e142fe461aac265d9b77d32f9b" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" is_pre_election: true
I20260809 07:58:14.746523 10401 raft_consensus.cc:2454] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 0.
I20260809 07:58:14.746523 10697 raft_consensus.cc:2454] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 0.
I20260809 07:58:14.746840 10482 leader_election.cc:302] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, 345c09825d4045548c139db75e4b6b38; no voters:
I20260809 07:58:14.746999 10876 raft_consensus.cc:2781] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:14.747056 10876 raft_consensus.cc:482] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:14.747115 10876 raft_consensus.cc:3037] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.748471 10876 raft_consensus.cc:504] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.748883 10876 leader_election.cc:288] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 election: Requested vote from peers a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783), 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359)
I20260809 07:58:14.749321 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3ef7e142fe461aac265d9b77d32f9b" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d"
I20260809 07:58:14.749357 10697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3ef7e142fe461aac265d9b77d32f9b" candidate_uuid: "13fdd531a60e4262ab80ed5f237ab092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "345c09825d4045548c139db75e4b6b38"
I20260809 07:58:14.749459 10401 raft_consensus.cc:3037] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.749459 10697 raft_consensus.cc:3037] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:14.750629 10401 raft_consensus.cc:2454] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 1.
I20260809 07:58:14.750628 10697 raft_consensus.cc:2454] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13fdd531a60e4262ab80ed5f237ab092 in term 1.
I20260809 07:58:14.750896 10482 leader_election.cc:302] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13fdd531a60e4262ab80ed5f237ab092, 345c09825d4045548c139db75e4b6b38; no voters:
I20260809 07:58:14.751066 10876 raft_consensus.cc:2781] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:14.751255 10876 raft_consensus.cc:686] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 1 LEADER]: Becoming Leader. State: Replica: 13fdd531a60e4262ab80ed5f237ab092, State: Running, Role: LEADER
I20260809 07:58:14.751401 10876 consensus_queue.cc:237] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } }
I20260809 07:58:14.752980 10236 catalog_manager.cc:5495] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "13fdd531a60e4262ab80ed5f237ab092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13fdd531a60e4262ab80ed5f237ab092" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:14.793923 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:14.790761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56748 (local address 127.8.51.66:33043)
0809 07:58:14.790891 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:14.790895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:14.790933 (+ 38us) server_negotiation.cc:407] Connection header received
0809 07:58:14.791100 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:14.791103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:14.791158 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:14.791234 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:14.791469 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.791986 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.792806 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:14.793031 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:14.793182 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:14.793427 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:14.793502 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:14.793579 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:14.793719 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 07:58:14.793771 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:14.800452 10697 raft_consensus.cc:1261] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Refusing update from remote peer 13fdd531a60e4262ab80ed5f237ab092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:14.800501 10401 raft_consensus.cc:1261] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d [term 1 FOLLOWER]: Refusing update from remote peer 13fdd531a60e4262ab80ed5f237ab092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:14.800822 10898 consensus_queue.cc:1035] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "345c09825d4045548c139db75e4b6b38" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 37359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:14.800981 10876 consensus_queue.cc:1035] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c1ff5b4d5a4426a95576b3cbf7446d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 07:58:14.813721 10844 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 07:58:16.364806 10236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:16.364952 10236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:16.367095 10236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44b4d8fca2504307b83b30939166a1d2: Sending DeleteTablet for 3 replicas of tablet 0f3ef7e142fe461aac265d9b77d32f9b
I20260809 07:58:16.367597 10383 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:16 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46836
I20260809 07:58:16.367668 10678 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:16 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56838
I20260809 07:58:16.367674 10530 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3ef7e142fe461aac265d9b77d32f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:16 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56730
I20260809 07:58:16.368014 10930 tablet_replica.cc:330] T 0f3ef7e142fe461aac265d9b77d32f9b P a6c1ff5b4d5a4426a95576b3cbf7446d: stopping tablet replica
I20260809 07:58:16.368076 10931 tablet_replica.cc:330] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: stopping tablet replica
I20260809 07:58:16.368208 10931 raft_consensus.cc:2229] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:16.368268 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 10315
I20260809 07:58:16.369725 10932 tablet_replica.cc:330] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: stopping tablet replica
I20260809 07:58:16.369858 10932 raft_consensus.cc:2229] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:16.368335 10931 raft_consensus.cc:2258] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:16.370102 10932 raft_consensus.cc:2258] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:16.370779 10931 ts_tablet_manager.cc:1905] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:16.371258 10932 ts_tablet_manager.cc:1905] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:16.373647 10931 ts_tablet_manager.cc:1918] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 07:58:16.373745 10931 log.cc:1196] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/0f3ef7e142fe461aac265d9b77d32f9b
I20260809 07:58:16.374042 10931 ts_tablet_manager.cc:1939] T 0f3ef7e142fe461aac265d9b77d32f9b P 345c09825d4045548c139db75e4b6b38: Deleting consensus metadata
I20260809 07:58:16.374696 10932 ts_tablet_manager.cc:1918] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 07:58:16.374696 10223 catalog_manager.cc:4841] TS 345c09825d4045548c139db75e4b6b38 (127.8.51.67:37359): tablet 0f3ef7e142fe461aac265d9b77d32f9b (table test-table [id=65735603a20c407e933312456a23cf07]) successfully deleted
I20260809 07:58:16.374783 10932 log.cc:1196] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/0f3ef7e142fe461aac265d9b77d32f9b
I20260809 07:58:16.375092 10932 ts_tablet_manager.cc:1939] T 0f3ef7e142fe461aac265d9b77d32f9b P 13fdd531a60e4262ab80ed5f237ab092: Deleting consensus metadata
I20260809 07:58:16.375792 10221 catalog_manager.cc:4841] TS 13fdd531a60e4262ab80ed5f237ab092 (127.8.51.66:33043): tablet 0f3ef7e142fe461aac265d9b77d32f9b (table test-table [id=65735603a20c407e933312456a23cf07]) successfully deleted
W20260809 07:58:16.379460 10223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:41783 (error 108)
I20260809 07:58:16.379720 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 10464
I20260809 07:58:16.381894 10935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:16.381383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41783 (local address 127.0.0.1:46852)
0809 07:58:16.381656 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:16.381749 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
W20260809 07:58:16.382535 10223 catalog_manager.cc:4584] TS a6c1ff5b4d5a4426a95576b3cbf7446d (127.8.51.65:41783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0f3ef7e142fe461aac265d9b77d32f9b: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41783: connect: Connection refused (error 111)
I20260809 07:58:16.388756 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 10609
I20260809 07:58:16.396083 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 10205
2026-08-09T07:58:16Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6664 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:16 dist-test-slave-njxd krb5kdc[10938](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:16 dist-test-slave-njxd krb5kdc[10938](info): set up 2 sockets
Aug 09 07:58:16 dist-test-slave-njxd krb5kdc[10938](info): commencing operation
krb5kdc: starting...
W20260809 07:58:17.455497 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:17 dist-test-slave-njxd krb5kdc[10938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:17.580546 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40713
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:40713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:17.694852 10952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:17.695165 10952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:17.695266 10952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:17.699782 10952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:17.699872 10952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:17.699910 10952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:17.699960 10952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:17.700016 10952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:17.705467 10952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:40713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:17.706600 10952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:17.707621 10952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 07:58:17.716398 10952 server_base.cc:1034] running on GCE node
W20260809 07:58:17.716428 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:17.716559 10961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:17.716429 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:17.717309 10952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:17.718449 10952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:17.719619 10952 hybrid_clock.cc:648] HybridClock initialized: now 1786262297719589 us; error 34 us; skew 500 ppm
Aug 09 07:58:17 dist-test-slave-njxd krb5kdc[10938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262297, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:17.722486 10952 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:17.723326 10952 webserver.cc:460] Webserver started at http://127.8.51.126:33917/ using document root <none> and password file <none>
I20260809 07:58:17.723898 10952 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:17.723984 10952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:17.724212 10952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:17.726346 10952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "58740e621f948a61f0919c2d9e54a377"
server_key_iv: "fb00d5fea00b7fbe3fb5d0fde2452d5e"
server_key_version: "encryptionkey@0"
I20260809 07:58:17.726891 10952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "58740e621f948a61f0919c2d9e54a377"
server_key_iv: "fb00d5fea00b7fbe3fb5d0fde2452d5e"
server_key_version: "encryptionkey@0"
I20260809 07:58:17.730528 10952 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 07:58:17.732903 10969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:17.734086 10952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 07:58:17.734216 10952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "58740e621f948a61f0919c2d9e54a377"
server_key_iv: "fb00d5fea00b7fbe3fb5d0fde2452d5e"
server_key_version: "encryptionkey@0"
I20260809 07:58:17.734318 10952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:17.747023 10952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:17.750025 10952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:17.750208 10952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:17.756932 10952 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:40713
I20260809 07:58:17.756950 11022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:40713 every 8 connection(s)
I20260809 07:58:17.757830 10952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:17.760440 11023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:17.765542 11023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: Bootstrap starting.
I20260809 07:58:17.766983 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 10952
I20260809 07:58:17.767095 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:17.767367 8397 external_mini_cluster.cc:1428] Setting key 725e244835bea04bdabbb607b47e895d
I20260809 07:58:17.768175 11023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:17.769054 11023 log.cc:824] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:17.770902 11023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: No bootstrap required, opened a new log
I20260809 07:58:17.774305 11023 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } }
I20260809 07:58:17.774540 11023 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:17.774632 11023 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2fb0427f67340e39fc3d6edc8b3cd9d, State: Initialized, Role: FOLLOWER
I20260809 07:58:17.775072 11023 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } }
I20260809 07:58:17.775228 11023 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:17.775311 11023 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:17.775413 11023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 0 FOLLOWER]: Advancing to term 1
Aug 09 07:58:17 dist-test-slave-njxd krb5kdc[10938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:17.776330 11023 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } }
I20260809 07:58:17.776659 11023 leader_election.cc:302] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2fb0427f67340e39fc3d6edc8b3cd9d; no voters:
I20260809 07:58:17.777005 11023 leader_election.cc:288] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:17.777112 11028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:17.777338 11028 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [term 1 LEADER]: Becoming Leader. State: Replica: b2fb0427f67340e39fc3d6edc8b3cd9d, State: Running, Role: LEADER
I20260809 07:58:17.777720 11028 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } }
I20260809 07:58:17.778373 11023 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:17.779206 11029 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2fb0427f67340e39fc3d6edc8b3cd9d. Latest consensus state: current_term: 1 leader_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } } }
I20260809 07:58:17.779349 11029 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:17.779687 11030 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2fb0427f67340e39fc3d6edc8b3cd9d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40713 } } }
I20260809 07:58:17.779847 11030 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:17.781730 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:17.768466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47440 (local address 127.8.51.126:40713)
0809 07:58:17.768882 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:17.768898 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:17.768929 (+ 31us) server_negotiation.cc:407] Connection header received
0809 07:58:17.769757 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:17.769782 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:17.770104 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:17.770417 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:17.771273 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:17.772216 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:17.773066 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:17.773523 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:17.773735 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:17.776361 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:17.776366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:17.776379 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:17.776426 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:17.778504 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:17.779031 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:17.779039 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:17.779046 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:17.779186 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:17.779601 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:17.779604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:17.779606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:17.780101 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:17.780321 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:17.780596 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 07:58:17.780931 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":117,"threads_started":1}
W20260809 07:58:17.783654 11045 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:17.783777 11045 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:17.783880 11038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:17.784567 11038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:17.789840 11038 catalog_manager.cc:1347] Generated new cluster ID: 18ebfc0d1b2a4d309b1c8d877d4abda5
I20260809 07:58:17.789899 11038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:17.817907 11038 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:17.819169 11038 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:17.829840 11038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2fb0427f67340e39fc3d6edc8b3cd9d: Generated new TSK 0
I20260809 07:58:17.830510 11038 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:17.860477 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:17.968686 11050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:17.968932 11050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:17.968974 11050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:17.973061 11050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:17.973119 11050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:17.973204 11050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:17.978297 11050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:17.979293 11050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:17.980343 11050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:17.989269 11055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:17.989276 11056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:17.989427 11058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:17.989459 11050 server_base.cc:1034] running on GCE node
I20260809 07:58:17.989970 11050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:17.990517 11050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:17.991724 11050 hybrid_clock.cc:648] HybridClock initialized: now 1786262297991679 us; error 43 us; skew 500 ppm
Aug 09 07:58:17 dist-test-slave-njxd krb5kdc[10938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262297, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:17.994354 11050 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:17.995144 11050 webserver.cc:460] Webserver started at http://127.8.51.65:36041/ using document root <none> and password file <none>
I20260809 07:58:17.995663 11050 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:17.995761 11050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:17.995975 11050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:17.997924 11050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "20ca06b5ddd54f7b9e48673c18c0bc32"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "ed7f50916a20c2a0dc074ab5017d3722"
server_key_iv: "f47c817b9e0129184665b7dc5ad4a3c5"
server_key_version: "encryptionkey@0"
I20260809 07:58:17.998430 11050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "20ca06b5ddd54f7b9e48673c18c0bc32"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "ed7f50916a20c2a0dc074ab5017d3722"
server_key_iv: "f47c817b9e0129184665b7dc5ad4a3c5"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.001973 11050 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:18.004221 11065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.005352 11050 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:18.005501 11050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "20ca06b5ddd54f7b9e48673c18c0bc32"
format_stamp: "Formatted at 2026-08-09 07:58:17 on dist-test-slave-njxd"
server_key: "ed7f50916a20c2a0dc074ab5017d3722"
server_key_iv: "f47c817b9e0129184665b7dc5ad4a3c5"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.005633 11050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:18.046835 11050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:18.050040 11050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:18.050235 11050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:18.050885 11050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:18.051734 11050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:18.051811 11050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.051903 11050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:18.051949 11050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.059978 11050 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:39227
I20260809 07:58:18.060045 11185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:39227 every 8 connection(s)
I20260809 07:58:18.060847 11050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:18.066732 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11050
I20260809 07:58:18.066844 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:18.067148 8397 external_mini_cluster.cc:1428] Setting key c7557abb400ae88af62d609f2b571d08
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[10938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262297, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:18.075318 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.062699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:52683 (local address 127.8.51.126:40713)
0809 07:58:18.062829 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:18.062833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:18.063634 (+ 801us) server_negotiation.cc:407] Connection header received
0809 07:58:18.064853 (+ 1219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:18.064855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:18.064900 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:18.064972 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:18.066177 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.066973 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.068146 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.068383 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.068487 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.071116 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:18.071121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:18.071123 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:18.071155 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:18.072968 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.073521 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.073526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.073529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.073656 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.073975 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.073981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.073986 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.074248 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:18.074365 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:18.074860 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 07:58:18.075072 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 07:58:18.075896 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.063065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40713 (local address 127.8.51.65:52683)
0809 07:58:18.063493 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:18.063532 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:18.064665 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:18.065111 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:18.065117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:18.065479 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:18.066016 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.066030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.067098 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.067101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.068013 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.068023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.068523 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.068527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.068718 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.069310 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:18.069346 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:18.070949 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:18.073087 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.073091 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.073103 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.073417 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.073746 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.073748 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.073750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.073880 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.074353 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:18.074358 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:18.074608 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 07:58:18.074773 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 07:58:18.075025 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":97,"threads_started":1}
I20260809 07:58:18.077142 11186 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40713
I20260809 07:58:18.077423 11186 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:18.078073 11186 heartbeater.cc:511] Master 127.8.51.126:40713 requested a full tablet report, sending...
I20260809 07:58:18.079762 10986 ts_manager.cc:194] Registered new tserver with Master: 20ca06b5ddd54f7b9e48673c18c0bc32 (127.8.51.65:39227)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:18.081108 10986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:52683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:18.094908 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:18.199522 11191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:18.199731 11191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:18.199767 11191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:18.203552 11191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:18.203598 11191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:18.203689 11191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:18.208566 11191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:18.209488 11191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:18.210433 11191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:18.219367 11197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:18.219461 11191 server_base.cc:1034] running on GCE node
W20260809 07:58:18.219367 11196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:18.219391 11199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:18.220016 11191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:18.220598 11191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:18.221767 11191 hybrid_clock.cc:648] HybridClock initialized: now 1786262298221742 us; error 34 us; skew 500 ppm
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[10938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262298, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:18.224257 11191 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:18.224992 11191 webserver.cc:460] Webserver started at http://127.8.51.66:34689/ using document root <none> and password file <none>
I20260809 07:58:18.225442 11191 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:18.225495 11191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:18.225709 11191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:18.227512 11191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "b40f126c6ea04a10babd2cf56e1237b7"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "90f82505233d58caea3d5627bca5800a"
server_key_iv: "3ad9ef3bf31e119f3c5a3dd0ae4cde6f"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.228047 11191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "b40f126c6ea04a10babd2cf56e1237b7"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "90f82505233d58caea3d5627bca5800a"
server_key_iv: "3ad9ef3bf31e119f3c5a3dd0ae4cde6f"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.231397 11191 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:18.233660 11206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.234746 11191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:18.234876 11191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "b40f126c6ea04a10babd2cf56e1237b7"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "90f82505233d58caea3d5627bca5800a"
server_key_iv: "3ad9ef3bf31e119f3c5a3dd0ae4cde6f"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.234977 11191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:18.253677 11191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:18.256294 11191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:18.256469 11191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:18.256994 11191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:18.257788 11191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:18.257851 11191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.257920 11191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:18.257957 11191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.266522 11191 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:41731
I20260809 07:58:18.266552 11328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:41731 every 8 connection(s)
I20260809 07:58:18.267557 11191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:18.270710 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11191
I20260809 07:58:18.270823 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:18.271097 8397 external_mini_cluster.cc:1428] Setting key bad20f2f091772e0c0177c0d968faa20
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[10938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262298, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:58:18.281804 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.269250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:52557 (local address 127.8.51.126:40713)
0809 07:58:18.269385 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:18.269389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:18.270189 (+ 800us) server_negotiation.cc:407] Connection header received
0809 07:58:18.271520 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:18.271524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:18.271582 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:18.271684 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:18.272810 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.273319 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.274469 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.274720 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.274830 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.277654 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:18.277662 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:18.277669 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:18.277703 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:18.279552 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.280112 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.280118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.280121 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.280235 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.280579 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.280583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.280584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.280765 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:18.280894 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:18.281540 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 07:58:18.281687 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:18.282780 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.269632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40713 (local address 127.8.51.66:52557)
0809 07:58:18.270038 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:18.270077 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:18.271293 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:18.271856 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:18.271863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:18.272206 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:18.272669 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.272682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.273445 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.273449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.274334 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.274343 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.274865 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.274869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.275034 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.275603 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:18.275620 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:18.277466 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:18.279711 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.279720 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.279736 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.280008 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.280327 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.280331 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.280333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.280466 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.280914 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:18.280923 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:18.281238 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 07:58:18.281471 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 07:58:18.281852 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260809 07:58:18.283803 11329 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40713
I20260809 07:58:18.284089 11329 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:18.284525 11329 heartbeater.cc:511] Master 127.8.51.126:40713 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:18.285614 10986 ts_manager.cc:194] Registered new tserver with Master: b40f126c6ea04a10babd2cf56e1237b7 (127.8.51.66:41731)
I20260809 07:58:18.286432 10986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:52557
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:18.299885 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:18.410585 11334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:18.410880 11334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:18.410954 11334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:18.414959 11334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:18.415055 11334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:18.415153 11334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:18.420588 11334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:18.421759 11334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:18.422852 11334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:18.432825 11340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:18.432971 11343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:18.432821 11341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:18.433158 11334 server_base.cc:1034] running on GCE node
I20260809 07:58:18.433754 11334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:18.434396 11334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:18.435545 11334 hybrid_clock.cc:648] HybridClock initialized: now 1786262298435526 us; error 30 us; skew 500 ppm
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[10938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262298, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:18.438683 11334 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:18.439546 11334 webserver.cc:460] Webserver started at http://127.8.51.67:37089/ using document root <none> and password file <none>
I20260809 07:58:18.440097 11334 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:18.440156 11334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:18.440326 11334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:18.442587 11334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "99e599594fd642ef9ab23406e8d18797"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "7e424b08a06dd5c1af18e2fcafead8c0"
server_key_iv: "a3f7b4d63e60943c2856d92404bdfbd2"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.443179 11334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "99e599594fd642ef9ab23406e8d18797"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "7e424b08a06dd5c1af18e2fcafead8c0"
server_key_iv: "a3f7b4d63e60943c2856d92404bdfbd2"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.447116 11334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:58:18.449717 11350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.450917 11334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:18.451048 11334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "99e599594fd642ef9ab23406e8d18797"
format_stamp: "Formatted at 2026-08-09 07:58:18 on dist-test-slave-njxd"
server_key: "7e424b08a06dd5c1af18e2fcafead8c0"
server_key_iv: "a3f7b4d63e60943c2856d92404bdfbd2"
server_key_version: "encryptionkey@0"
I20260809 07:58:18.451157 11334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:18.475605 11334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:18.478425 11334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:18.478631 11334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:18.479296 11334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:18.480185 11334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:18.480232 11334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.480293 11334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:18.480330 11334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:18.488814 11334 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:32921
I20260809 07:58:18.488838 11472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:32921 every 8 connection(s)
I20260809 07:58:18.489749 11334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:18.496497 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11334
I20260809 07:58:18.496618 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:18.496950 8397 external_mini_cluster.cc:1428] Setting key 546861228a47ffeb8532c8d685c0f2ea
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[10938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262298, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:18.502851 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.491468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38249 (local address 127.8.51.126:40713)
0809 07:58:18.491603 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:18.491607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:18.492430 (+ 823us) server_negotiation.cc:407] Connection header received
0809 07:58:18.493701 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:18.493705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:18.493781 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:18.493879 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:18.495033 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.495567 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.496929 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.497197 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.497321 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.499757 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:18.499760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:18.499762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:18.499786 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:18.501053 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.501524 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.501527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.501528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.501643 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:18.501947 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:18.501950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:18.501951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:18.502121 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:18.502198 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:18.502631 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 07:58:18.502735 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 07:58:18.503651 11475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:18.491850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40713 (local address 127.8.51.67:38249)
0809 07:58:18.492284 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:18.492324 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:18.493475 (+ 1151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:18.494050 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:18.494057 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:18.494407 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:18.494887 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.494900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.495693 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.495698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.496805 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:18.496817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:18.497358 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:18.497362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:18.497539 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:18.498175 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:18.498191 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:18.499600 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:18.501155 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.501160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.501172 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.501417 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.501731 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:18.501733 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:18.501734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:18.501865 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:18.502205 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:18.502210 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:18.502449 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 07:58:18.502602 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 07:58:18.502846 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":114,"threads_started":1}
I20260809 07:58:18.504743 11473 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40713
I20260809 07:58:18.504958 11473 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:18.505379 11473 heartbeater.cc:511] Master 127.8.51.126:40713 requested a full tablet report, sending...
I20260809 07:58:18.506325 10986 ts_manager.cc:194] Registered new tserver with Master: 99e599594fd642ef9ab23406e8d18797 (127.8.51.67:32921)
I20260809 07:58:18.506863 10986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:38249
I20260809 07:58:18.511051 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 07:58:18.526304 11026 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:18.524668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47446 (local address 127.8.51.126:40713)
0809 07:58:18.524824 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:18.524831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:18.525017 (+ 186us) server_negotiation.cc:407] Connection header received
0809 07:58:18.525201 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:18.525204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:18.525247 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:18.525328 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:18.526141 (+ 813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47446: BlockingRecv error: recv got EOF from 127.0.0.1:47446 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 07:58:18.527169 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11050
I20260809 07:58:18.534492 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11191
I20260809 07:58:18.541951 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11334
I20260809 07:58:18.547820 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 10952
2026-08-09T07:58:18Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2149 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[11485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[11485](info): set up 2 sockets
Aug 09 07:58:18 dist-test-slave-njxd krb5kdc[11485](info): commencing operation
krb5kdc: starting...
W20260809 07:58:19.602560 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:19 dist-test-slave-njxd krb5kdc[11485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:19.724118 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35019
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:35019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:19.834441 11499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:19.834771 11499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:19.834846 11499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:19.838742 11499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:19.838821 11499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:19.838860 11499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:19.838905 11499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:19.838943 11499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:19.843951 11499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:35019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:19.844986 11499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:19.846028 11499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:19.854276 11506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:19.854281 11508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:19.854318 11499 server_base.cc:1034] running on GCE node
W20260809 07:58:19.854300 11505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:19.855067 11499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:19.856166 11499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:19.857345 11499 hybrid_clock.cc:648] HybridClock initialized: now 1786262299857330 us; error 35 us; skew 500 ppm
Aug 09 07:58:19 dist-test-slave-njxd krb5kdc[11485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262299, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:19.864251 11499 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:19.865170 11499 webserver.cc:460] Webserver started at http://127.8.51.126:38349/ using document root <none> and password file <none>
I20260809 07:58:19.865797 11499 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:19.865882 11499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:19.866097 11499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:19.868232 11499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "7af0cc85a41446799f3516206ea65037"
format_stamp: "Formatted at 2026-08-09 07:58:19 on dist-test-slave-njxd"
server_key: "82521070b7331aeb41fe357a99d24c5e"
server_key_iv: "0fb0e764e854c12bd67fbf8b853dc37c"
server_key_version: "encryptionkey@0"
I20260809 07:58:19.868813 11499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "7af0cc85a41446799f3516206ea65037"
format_stamp: "Formatted at 2026-08-09 07:58:19 on dist-test-slave-njxd"
server_key: "82521070b7331aeb41fe357a99d24c5e"
server_key_iv: "0fb0e764e854c12bd67fbf8b853dc37c"
server_key_version: "encryptionkey@0"
I20260809 07:58:19.872592 11499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 07:58:19.874989 11518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:19.876140 11499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:19.876264 11499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "7af0cc85a41446799f3516206ea65037"
format_stamp: "Formatted at 2026-08-09 07:58:19 on dist-test-slave-njxd"
server_key: "82521070b7331aeb41fe357a99d24c5e"
server_key_iv: "0fb0e764e854c12bd67fbf8b853dc37c"
server_key_version: "encryptionkey@0"
I20260809 07:58:19.876361 11499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:19.887252 11499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:19.889801 11499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:19.889966 11499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:19.896245 11499 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:35019
I20260809 07:58:19.896522 11574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:35019 every 8 connection(s)
I20260809 07:58:19.897125 11499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:19.899653 11575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:19.899971 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11499
I20260809 07:58:19.900107 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:19.900403 8397 external_mini_cluster.cc:1428] Setting key a8783a5a9d1930c16bd41f50b3f86674
I20260809 07:58:19.906180 11575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037: Bootstrap starting.
I20260809 07:58:19.908766 11575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037: Neither blocks nor log segments found. Creating new log.
Aug 09 07:58:19 dist-test-slave-njxd krb5kdc[11485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:19.909654 11575 log.cc:824] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:19.911375 11575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037: No bootstrap required, opened a new log
I20260809 07:58:19.913983 11578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:19.901537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.8.51.126:35019)
0809 07:58:19.902004 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:19.902019 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:19.902053 (+ 34us) server_negotiation.cc:407] Connection header received
0809 07:58:19.902765 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:19.902783 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:19.903110 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:19.903362 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:19.904250 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:19.905116 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:19.906272 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:19.906740 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:19.906855 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:19.909641 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:19.909646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:19.909662 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:19.909688 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:19.911306 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:19.911788 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:19.911792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:19.911796 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:19.911907 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:19.912198 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:19.912200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:19.912201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:19.912552 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:19.912713 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:19.912987 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 07:58:19.913251 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":123,"threads_started":1}
I20260809 07:58:19.915390 11575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } }
I20260809 07:58:19.915660 11575 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:19.915722 11575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af0cc85a41446799f3516206ea65037, State: Initialized, Role: FOLLOWER
I20260809 07:58:19.916234 11575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } }
I20260809 07:58:19.916401 11575 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:19.916471 11575 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:19.916577 11575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:19.916908 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 07:58:19.917523 11575 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } }
I20260809 07:58:19.917883 11575 leader_election.cc:302] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7af0cc85a41446799f3516206ea65037; no voters:
I20260809 07:58:19.918179 11575 leader_election.cc:288] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:19.918305 11580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:19.918570 11580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [term 1 LEADER]: Becoming Leader. State: Replica: 7af0cc85a41446799f3516206ea65037, State: Running, Role: LEADER
I20260809 07:58:19.918954 11580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } }
I20260809 07:58:19.919446 11575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:19.920681 11582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7af0cc85a41446799f3516206ea65037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } } }
I20260809 07:58:19.920830 11582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:19.921103 11582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7af0cc85a41446799f3516206ea65037. Latest consensus state: current_term: 1 leader_uuid: "7af0cc85a41446799f3516206ea65037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af0cc85a41446799f3516206ea65037" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35019 } } }
I20260809 07:58:19.921196 11582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:19.921398 11590 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:19.924443 11590 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:19.930833 11590 catalog_manager.cc:1347] Generated new cluster ID: 61670e9e645a4d69ba1560acb023a4a9
I20260809 07:58:19.930925 11590 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:19.940263 11578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:19.933683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38058 (local address 127.8.51.126:35019)
0809 07:58:19.933823 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:19.933828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:19.934716 (+ 888us) server_negotiation.cc:407] Connection header received
0809 07:58:19.934884 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:19.934888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:19.934931 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:19.934979 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:19.935775 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:19.936668 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:19.937848 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:19.938224 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:19.938338 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:19.939226 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:19.939230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:19.939233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:19.939808 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:19.939842 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:19.939863 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:19.939952 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:19.940039 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 07:58:19.940108 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 07:58:19.947736 11590 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:19.948654 11590 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:19.954095 11590 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7af0cc85a41446799f3516206ea65037: Generated new TSK 0
I20260809 07:58:19.954757 11590 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:58:19.963223 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11499
2026-08-09T07:58:19Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1413 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:20 dist-test-slave-njxd krb5kdc[11610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:20 dist-test-slave-njxd krb5kdc[11610](info): set up 2 sockets
Aug 09 07:58:20 dist-test-slave-njxd krb5kdc[11610](info): commencing operation
krb5kdc: starting...
W20260809 07:58:21.010991 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:21.130679 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38795
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:21.234688 11623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:21.234963 11623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:21.235044 11623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:21.238893 11623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:21.238973 11623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:21.239023 11623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:21.239090 11623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:21.239126 11623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:21.244174 11623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:21.245172 11623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:21.246152 11623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:21.254463 11632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.254478 11628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.254535 11629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:21.254717 11623 server_base.cc:1034] running on GCE node
I20260809 07:58:21.255299 11623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:21.256345 11623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:21.257501 11623 hybrid_clock.cc:648] HybridClock initialized: now 1786262301257483 us; error 31 us; skew 500 ppm
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:21.260317 11623 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:21.261217 11623 webserver.cc:460] Webserver started at http://127.8.51.126:36321/ using document root <none> and password file <none>
I20260809 07:58:21.261804 11623 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:21.261868 11623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:21.262035 11623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:21.263998 11623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "c0a65de3b33e42159e2eded02d86dc44"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "000f4596c6b98719065681671a6ab6ca"
server_key_iv: "2a710714278d16ff8046d5c00af5d303"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.264499 11623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "c0a65de3b33e42159e2eded02d86dc44"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "000f4596c6b98719065681671a6ab6ca"
server_key_iv: "2a710714278d16ff8046d5c00af5d303"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.267953 11623 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:21.270153 11640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.271335 11623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:21.271433 11623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c0a65de3b33e42159e2eded02d86dc44"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "000f4596c6b98719065681671a6ab6ca"
server_key_iv: "2a710714278d16ff8046d5c00af5d303"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.271513 11623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:21.292543 11623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:21.295624 11623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:21.295778 11623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:21.302595 11623 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38795
I20260809 07:58:21.302886 11695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38795 every 8 connection(s)
I20260809 07:58:21.303562 11623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:21.306281 11697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:21.306597 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11623
I20260809 07:58:21.306712 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:21.307029 8397 external_mini_cluster.cc:1428] Setting key 2a256fbcec93ad332c7cab4d30409ce0
I20260809 07:58:21.313145 11697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44: Bootstrap starting.
I20260809 07:58:21.315944 11697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44: Neither blocks nor log segments found. Creating new log.
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:21.316736 11697 log.cc:824] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:21.318876 11697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44: No bootstrap required, opened a new log
I20260809 07:58:21.321168 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:21.308353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.8.51.126:38795)
0809 07:58:21.308755 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:21.308779 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:21.308814 (+ 35us) server_negotiation.cc:407] Connection header received
0809 07:58:21.309476 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:21.309493 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:21.309836 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:21.310144 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:21.311030 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.312010 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.313151 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.313708 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.313824 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:21.316630 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:21.316637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:21.316653 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:21.316685 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:21.318401 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.318884 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.318888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.318892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.319040 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.319350 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.319352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.319353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.319720 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:21.319850 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:21.320162 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 07:58:21.320447 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":122,"threads_started":1}
I20260809 07:58:21.322796 11697 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } }
I20260809 07:58:21.323045 11697 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:21.323159 11697 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a65de3b33e42159e2eded02d86dc44, State: Initialized, Role: FOLLOWER
I20260809 07:58:21.323589 11697 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } }
I20260809 07:58:21.323740 11697 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:21.323827 11697 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:21.323951 11697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:21.324815 11697 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } }
I20260809 07:58:21.325168 11697 leader_election.cc:302] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0a65de3b33e42159e2eded02d86dc44; no voters:
I20260809 07:58:21.325521 11697 leader_election.cc:288] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:21.325647 11702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:21.325863 11702 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [term 1 LEADER]: Becoming Leader. State: Replica: c0a65de3b33e42159e2eded02d86dc44, State: Running, Role: LEADER
I20260809 07:58:21.326257 11702 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } }
I20260809 07:58:21.326771 11697 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:21.327857 11703 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0a65de3b33e42159e2eded02d86dc44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } } }
I20260809 07:58:21.327988 11703 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:21.328307 11704 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0a65de3b33e42159e2eded02d86dc44. Latest consensus state: current_term: 1 leader_uuid: "c0a65de3b33e42159e2eded02d86dc44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0a65de3b33e42159e2eded02d86dc44" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38795 } } }
I20260809 07:58:21.328382 11711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:21.328483 11704 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:21.331251 11711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:21.336838 11711 catalog_manager.cc:1347] Generated new cluster ID: 616761510d8445f5af04faf085a7c863
I20260809 07:58:21.336907 11711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:21.351747 11711 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:21.352689 11711 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:21.360332 11711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0a65de3b33e42159e2eded02d86dc44: Generated new TSK 0
I20260809 07:58:21.360896 11711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:21.392028 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:21.509166 11724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:21.509420 11724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:21.509488 11724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:21.513466 11724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:21.513530 11724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:21.513662 11724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:21.518927 11724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:21.520004 11724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:21.521045 11724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:21.530642 11734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.530663 11729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.530642 11730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:21.530930 11724 server_base.cc:1034] running on GCE node
I20260809 07:58:21.531332 11724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:21.531991 11724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:21.533170 11724 hybrid_clock.cc:648] HybridClock initialized: now 1786262301533140 us; error 49 us; skew 500 ppm
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:21.536005 11724 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:21.536857 11724 webserver.cc:460] Webserver started at http://127.8.51.65:42665/ using document root <none> and password file <none>
I20260809 07:58:21.537420 11724 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:21.537511 11724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:21.537770 11724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:21.539808 11724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "4709be71716f4bbeb1d8bf934c11141d"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "f246ca811f49f1aee9baf9af4e17d142"
server_key_iv: "76041fdbb822f3fac26c9c394d9635bf"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.540381 11724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "4709be71716f4bbeb1d8bf934c11141d"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "f246ca811f49f1aee9baf9af4e17d142"
server_key_iv: "76041fdbb822f3fac26c9c394d9635bf"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.544009 11724 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:58:21.546377 11741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.547756 11724 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:21.547888 11724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "4709be71716f4bbeb1d8bf934c11141d"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "f246ca811f49f1aee9baf9af4e17d142"
server_key_iv: "76041fdbb822f3fac26c9c394d9635bf"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.547994 11724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:21.564162 11724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:21.567348 11724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:21.567543 11724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:21.568107 11724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:21.568899 11724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:21.568965 11724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.569032 11724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:21.569077 11724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.577512 11724 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:43319
I20260809 07:58:21.577612 11863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:43319 every 8 connection(s)
I20260809 07:58:21.578431 11724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:21.578776 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11724
I20260809 07:58:21.578905 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:21.579269 8397 external_mini_cluster.cc:1428] Setting key d86ce0ab3563db84c390d385643dfb68
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:21.593947 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:21.580212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:52535 (local address 127.8.51.126:38795)
0809 07:58:21.580354 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:21.580358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:21.581399 (+ 1041us) server_negotiation.cc:407] Connection header received
0809 07:58:21.583531 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:21.583534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:21.583583 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:21.583685 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:21.585117 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.586035 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.587217 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.587673 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.587811 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:21.590527 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:21.590530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:21.590532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:21.590555 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:21.591892 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.592352 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.592355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.592356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.592427 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.592744 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.592747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.592749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.592935 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:21.593043 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:21.593621 (+ 578us) server_negotiation.cc:299] Negotiation successful
0809 07:58:21.593765 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:21.594731 11866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:21.580721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38795 (local address 127.8.51.65:52535)
0809 07:58:21.581218 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:21.581279 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:21.583288 (+ 2009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:21.583847 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:21.583858 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:21.584384 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:21.584969 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:21.584984 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.586157 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.586159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:21.587086 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:21.587096 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.587820 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.587823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:21.587959 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:21.588548 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:21.588564 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:21.590362 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:21.591996 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:21.592000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:21.592012 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:21.592268 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:21.592501 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:21.592503 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:21.592505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:21.592630 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:21.593043 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:21.593051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:21.593322 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 07:58:21.593544 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 07:58:21.593877 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":117,"threads_started":1}
I20260809 07:58:21.595974 11864 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38795
I20260809 07:58:21.596216 11864 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:21.596683 11864 heartbeater.cc:511] Master 127.8.51.126:38795 requested a full tablet report, sending...
I20260809 07:58:21.598157 11658 ts_manager.cc:194] Registered new tserver with Master: 4709be71716f4bbeb1d8bf934c11141d (127.8.51.65:43319)
I20260809 07:58:21.599339 11658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:52535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:21.610033 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:21.720196 11869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:21.720518 11869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:21.720604 11869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:21.724990 11869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:21.725103 11869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:21.725198 11869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:21.730783 11869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:21.731838 11869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:21.732858 11869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:21.742426 11877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.742437 11875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.742437 11874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:21.742648 11869 server_base.cc:1034] running on GCE node
I20260809 07:58:21.743202 11869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:21.743762 11869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:21.744911 11869 hybrid_clock.cc:648] HybridClock initialized: now 1786262301744879 us; error 43 us; skew 500 ppm
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:21.747658 11869 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:21.748538 11869 webserver.cc:460] Webserver started at http://127.8.51.66:38925/ using document root <none> and password file <none>
I20260809 07:58:21.749078 11869 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:21.749176 11869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:21.749414 11869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:21.751420 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "0f931e9a1a894a03b65415fe451e16cb"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "45187a0a7f9703ee52c7cdede47cbc6f"
server_key_iv: "44ff91a697afa596f1a79b22a25eccd6"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.752004 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "0f931e9a1a894a03b65415fe451e16cb"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "45187a0a7f9703ee52c7cdede47cbc6f"
server_key_iv: "44ff91a697afa596f1a79b22a25eccd6"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.755656 11869 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 07:58:21.757900 11884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.759014 11869 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:21.759137 11869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "0f931e9a1a894a03b65415fe451e16cb"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "45187a0a7f9703ee52c7cdede47cbc6f"
server_key_iv: "44ff91a697afa596f1a79b22a25eccd6"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.759246 11869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:21.810855 11869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:21.814216 11869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:21.814415 11869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:21.815033 11869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:21.815866 11869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:21.815932 11869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.816004 11869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:21.816044 11869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:21.824709 11869 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33249
I20260809 07:58:21.824755 12002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33249 every 8 connection(s)
I20260809 07:58:21.825559 11869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:21.827231 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 11869
I20260809 07:58:21.827342 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:21.827706 8397 external_mini_cluster.cc:1428] Setting key 6f32502055bd29c478ede7c7ce569645
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:21.841089 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:21.827312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:39345 (local address 127.8.51.126:38795)
0809 07:58:21.827473 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:21.827479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:21.828471 (+ 992us) server_negotiation.cc:407] Connection header received
0809 07:58:21.830086 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:21.830089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:21.830148 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:21.830241 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:21.831587 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.832128 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.833935 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.834235 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.834322 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:21.837418 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:21.837421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:21.837423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:21.837447 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:21.838941 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.839479 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.839482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.839483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.839577 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:21.839931 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:21.839935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:21.839937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:21.840126 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:21.840250 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:21.840845 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 07:58:21.840970 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 07:58:21.842036 12006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:21.827868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38795 (local address 127.8.51.66:39345)
0809 07:58:21.828332 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:21.828385 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:21.829890 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:21.830407 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:21.830414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:21.830765 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:21.831421 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:21.831443 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.832265 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.832271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:21.833809 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:21.833824 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:21.834397 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:21.834402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:21.834662 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:21.835292 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:21.835320 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:21.837239 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:21.839045 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:21.839050 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:21.839062 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:21.839306 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:21.839696 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:21.839699 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:21.839701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:21.839833 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:21.840265 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:21.840305 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:21.840536 (+ 231us) client_negotiation.cc:769] Sending connection context
0809 07:58:21.840787 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 07:58:21.841155 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260809 07:58:21.843153 12003 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38795
I20260809 07:58:21.843427 12003 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:21.844041 12003 heartbeater.cc:511] Master 127.8.51.126:38795 requested a full tablet report, sending...
I20260809 07:58:21.845057 11658 ts_manager.cc:194] Registered new tserver with Master: 0f931e9a1a894a03b65415fe451e16cb (127.8.51.66:33249)
I20260809 07:58:21.845685 11658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:39345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:21.856729 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:21.969192 12009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:21.969457 12009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:21.969501 12009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:21.973588 12009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:21.973676 12009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:21.973737 12009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:21.979189 12009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:21.980191 12009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:21.981172 12009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:21.990278 12016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.990272 12014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:21.990278 12018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:21.990497 12009 server_base.cc:1034] running on GCE node
I20260809 07:58:21.991036 12009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:21.991632 12009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:21.992813 12009 hybrid_clock.cc:648] HybridClock initialized: now 1786262301992798 us; error 27 us; skew 500 ppm
Aug 09 07:58:21 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:21.995589 12009 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:21.996385 12009 webserver.cc:460] Webserver started at http://127.8.51.67:41791/ using document root <none> and password file <none>
I20260809 07:58:21.996887 12009 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:21.996943 12009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:21.997097 12009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:21.999053 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "ec83b8d59668486494a0a58f449ed911"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "4cdc878a9b8ca5c8bf4f457163e5f61d"
server_key_iv: "5b46a1cfb8219f322800196fb2f5777f"
server_key_version: "encryptionkey@0"
I20260809 07:58:21.999554 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "ec83b8d59668486494a0a58f449ed911"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "4cdc878a9b8ca5c8bf4f457163e5f61d"
server_key_iv: "5b46a1cfb8219f322800196fb2f5777f"
server_key_version: "encryptionkey@0"
I20260809 07:58:22.003185 12009 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 07:58:22.005539 12025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:22.006843 12009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:22.006975 12009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "ec83b8d59668486494a0a58f449ed911"
format_stamp: "Formatted at 2026-08-09 07:58:21 on dist-test-slave-njxd"
server_key: "4cdc878a9b8ca5c8bf4f457163e5f61d"
server_key_iv: "5b46a1cfb8219f322800196fb2f5777f"
server_key_version: "encryptionkey@0"
I20260809 07:58:22.007084 12009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:22.033097 12009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:22.036597 12009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:22.036811 12009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:22.037424 12009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:22.038275 12009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:22.038342 12009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:22.038417 12009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:22.038455 12009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:22.047034 12009 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:42103
I20260809 07:58:22.047058 12146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:42103 every 8 connection(s)
I20260809 07:58:22.047847 12009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:22.053820 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12009
I20260809 07:58:22.053949 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:22.054242 8397 external_mini_cluster.cc:1428] Setting key 66f6ada0b1a68fe295656f5b49cfdc37
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[11610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262301, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:22.060905 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:22.049626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:58475 (local address 127.8.51.126:38795)
0809 07:58:22.049763 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:22.049766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:22.050581 (+ 815us) server_negotiation.cc:407] Connection header received
0809 07:58:22.052072 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:22.052075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:22.052118 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:22.052190 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:22.053494 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.054316 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.055434 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.055674 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.055804 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:22.058050 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:22.058052 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:22.058054 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:22.058076 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:22.059278 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:22.059714 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:22.059716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:22.059717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:22.059788 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:22.060052 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:22.060053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:22.060055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:22.060216 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:22.060287 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:22.060681 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 07:58:22.060795 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 07:58:22.061728 12149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:22.050012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38795 (local address 127.8.51.67:58475)
0809 07:58:22.050442 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:22.050483 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:22.051849 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:22.052385 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:22.052392 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:22.052789 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:22.053335 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:22.053348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.054420 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.054423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:22.055312 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:22.055320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.055855 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.055859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:22.056009 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:22.056492 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:22.056506 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:22.057903 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:22.059377 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:22.059382 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:22.059393 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:22.059626 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:22.059858 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:22.059860 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:22.059862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:22.059982 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:22.060295 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:22.060299 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:22.060503 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 07:58:22.060639 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 07:58:22.060889 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":107,"threads_started":1}
I20260809 07:58:22.062873 12147 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38795
I20260809 07:58:22.063109 12147 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:22.063544 12147 heartbeater.cc:511] Master 127.8.51.126:38795 requested a full tablet report, sending...
I20260809 07:58:22.064427 11658 ts_manager.cc:194] Registered new tserver with Master: ec83b8d59668486494a0a58f449ed911 (127.8.51.67:42103)
I20260809 07:58:22.064930 11658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:58475
I20260809 07:58:22.067618 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[11610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262302, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[11610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262302, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:22.093407 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:22.085388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.8.51.126:38795)
0809 07:58:22.085547 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:22.085552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:22.085740 (+ 188us) server_negotiation.cc:407] Connection header received
0809 07:58:22.085911 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:22.085913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:22.085958 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:22.086040 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:22.086721 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.087223 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.087984 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:22.088192 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:22.088289 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:22.090595 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:22.090598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:22.090600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:22.090622 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:22.091802 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:22.092203 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:22.092207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:22.092209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:22.092289 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:22.092551 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:22.092555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:22.092557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:22.092771 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:22.092910 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:22.093143 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 07:58:22.093259 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 07:58:22.093791 11658 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50022
I20260809 07:58:22.094555 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11724
I20260809 07:58:22.102588 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11869
I20260809 07:58:22.109962 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12009
I20260809 07:58:22.116276 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 11623
2026-08-09T07:58:22Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2156 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[12160](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[12160](info): set up 2 sockets
Aug 09 07:58:22 dist-test-slave-njxd krb5kdc[12160](info): commencing operation
krb5kdc: starting...
W20260809 07:58:23.163918 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:23.288309 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38149
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:23.398030 12174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:23.398396 12174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:23.398474 12174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:23.402338 12174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:23.402405 12174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:23.402443 12174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:23.402478 12174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:23.402514 12174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:23.407407 12174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:23.408354 12174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:23.409314 12174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 07:58:23.417546 12174 server_base.cc:1034] running on GCE node
W20260809 07:58:23.417505 12180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:23.417513 12181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:23.417505 12184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:23.418308 12174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:23.419342 12174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:23.420534 12174 hybrid_clock.cc:648] HybridClock initialized: now 1786262303420519 us; error 26 us; skew 500 ppm
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:23.423274 12174 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:23.424149 12174 webserver.cc:460] Webserver started at http://127.8.51.126:37705/ using document root <none> and password file <none>
I20260809 07:58:23.424700 12174 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:23.424790 12174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:23.425015 12174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:23.427068 12174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "94e8445c6fbc42bba01b56573c95af3e"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "e2448fab90732eecbc68025ef9ff36c6"
server_key_iv: "2e33a5e0b904b63ddd9429a586cb5654"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.427636 12174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "94e8445c6fbc42bba01b56573c95af3e"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "e2448fab90732eecbc68025ef9ff36c6"
server_key_iv: "2e33a5e0b904b63ddd9429a586cb5654"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.431380 12174 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 07:58:23.433781 12191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.434929 12174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:23.435065 12174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "94e8445c6fbc42bba01b56573c95af3e"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "e2448fab90732eecbc68025ef9ff36c6"
server_key_iv: "2e33a5e0b904b63ddd9429a586cb5654"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.435176 12174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:23.453897 12174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:23.457334 12174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:23.457557 12174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:23.464674 12174 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38149
I20260809 07:58:23.464689 12246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38149 every 8 connection(s)
I20260809 07:58:23.465703 12174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:23.468492 12247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:23.474010 12247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: Bootstrap starting.
I20260809 07:58:23.474455 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12174
I20260809 07:58:23.474606 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:23.474911 8397 external_mini_cluster.cc:1428] Setting key c86ea581ba5904c696422874d3d51cec
I20260809 07:58:23.476883 12247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:23.477682 12247 log.cc:824] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:23.479864 12247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: No bootstrap required, opened a new log
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:23.484475 12247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } }
I20260809 07:58:23.484728 12247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:23.484800 12247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e8445c6fbc42bba01b56573c95af3e, State: Initialized, Role: FOLLOWER
I20260809 07:58:23.485234 12247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } }
I20260809 07:58:23.485379 12247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:23.485460 12247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:23.485574 12247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:23.486470 12247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } }
I20260809 07:58:23.486791 12247 leader_election.cc:302] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94e8445c6fbc42bba01b56573c95af3e; no voters:
I20260809 07:58:23.487160 12247 leader_election.cc:288] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:23.487238 12253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:23.487447 12253 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [term 1 LEADER]: Becoming Leader. State: Replica: 94e8445c6fbc42bba01b56573c95af3e, State: Running, Role: LEADER
I20260809 07:58:23.487789 12253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } }
I20260809 07:58:23.488405 12247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:23.489668 12255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94e8445c6fbc42bba01b56573c95af3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } } }
I20260809 07:58:23.489806 12255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:23.490183 12254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94e8445c6fbc42bba01b56573c95af3e. Latest consensus state: current_term: 1 leader_uuid: "94e8445c6fbc42bba01b56573c95af3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e8445c6fbc42bba01b56573c95af3e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38149 } } }
I20260809 07:58:23.490360 12254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:23.490887 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:23.476352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43158 (local address 127.8.51.126:38149)
0809 07:58:23.476779 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:23.476794 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:23.476829 (+ 35us) server_negotiation.cc:407] Connection header received
0809 07:58:23.477701 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:23.477723 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:23.478129 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:23.478509 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:23.479429 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.480449 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.481638 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.482096 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.482228 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:23.485205 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:23.485210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:23.485222 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:23.485248 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:23.487263 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.487759 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.487766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.487772 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.487932 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.488233 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.488236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.488237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.488675 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:23.488863 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:23.489605 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 07:58:23.489916 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":123,"threads_started":1}
W20260809 07:58:23.493778 12268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:23.493853 12268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:23.493908 12262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:23.494765 12262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:23.499665 12262 catalog_manager.cc:1347] Generated new cluster ID: 834bbce9445c4be4912db1117b81d1ec
I20260809 07:58:23.499722 12262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:23.507123 12262 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:23.507910 12262 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:23.514662 12262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94e8445c6fbc42bba01b56573c95af3e: Generated new TSK 0
I20260809 07:58:23.515267 12262 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:23.546841 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:23.670271 12274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:23.670512 12274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:23.670570 12274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:23.674561 12274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:23.674633 12274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:23.674719 12274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:23.680014 12274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:23.681033 12274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:23.682112 12274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:23.691534 12282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:23.691532 12280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:23.691632 12274 server_base.cc:1034] running on GCE node
W20260809 07:58:23.691540 12279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:23.692107 12274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:23.692739 12274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:23.693912 12274 hybrid_clock.cc:648] HybridClock initialized: now 1786262303693892 us; error 32 us; skew 500 ppm
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:23.696569 12274 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:23.697371 12274 webserver.cc:460] Webserver started at http://127.8.51.65:45557/ using document root <none> and password file <none>
I20260809 07:58:23.697973 12274 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:23.698060 12274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:23.698282 12274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:23.700289 12274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "072d0541de344224a3d14d118892594d"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "65aed6a0f9115b3e6172b569da5b4fe8"
server_key_iv: "b404682ed71f8f00766021b70359d030"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.700848 12274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "072d0541de344224a3d14d118892594d"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "65aed6a0f9115b3e6172b569da5b4fe8"
server_key_iv: "b404682ed71f8f00766021b70359d030"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.704401 12274 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:58:23.706701 12289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.707813 12274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:23.707938 12274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "072d0541de344224a3d14d118892594d"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "65aed6a0f9115b3e6172b569da5b4fe8"
server_key_iv: "b404682ed71f8f00766021b70359d030"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.708042 12274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:23.721706 12274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:23.724324 12274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:23.724511 12274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:23.725049 12274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:23.725886 12274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:23.725953 12274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.726033 12274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:23.726079 12274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.734493 12274 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:36407
I20260809 07:58:23.734515 12415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:36407 every 8 connection(s)
I20260809 07:58:23.735369 12274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:23.743934 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12274
I20260809 07:58:23.744065 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:23.744366 8397 external_mini_cluster.cc:1428] Setting key 4f84fc8ad33b71144b589f43f07165c2
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:23.750471 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:23.737390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:56251 (local address 127.8.51.126:38149)
0809 07:58:23.737541 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:23.737549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:23.738375 (+ 826us) server_negotiation.cc:407] Connection header received
0809 07:58:23.739943 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:23.739947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:23.739996 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:23.740072 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:23.741191 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.741883 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.743195 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.743438 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.743518 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:23.746365 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:23.746371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:23.746377 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:23.746410 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:23.748095 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.748776 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.748778 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.748780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.748856 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.749242 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.749245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.749246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.749413 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:23.749489 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:23.750073 (+ 584us) server_negotiation.cc:299] Negotiation successful
0809 07:58:23.750232 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:58:23.751070 12419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:23.737696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38149 (local address 127.8.51.65:56251)
0809 07:58:23.738146 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:23.738251 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:23.739744 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:23.740250 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:23.740256 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:23.740593 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:23.741053 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:23.741066 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.741984 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.741987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:23.743078 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:23.743088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.743584 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.743587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:23.743761 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:23.744492 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:23.744512 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:23.746196 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:23.748221 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:23.748228 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:23.748246 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:23.748635 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:23.748946 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:23.748951 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:23.748954 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:23.749150 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:23.749507 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:23.749511 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:23.749816 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 07:58:23.749989 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 07:58:23.750235 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":119,"threads_started":1}
I20260809 07:58:23.752261 12416 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38149
I20260809 07:58:23.752526 12416 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:23.753152 12416 heartbeater.cc:511] Master 127.8.51.126:38149 requested a full tablet report, sending...
I20260809 07:58:23.754956 12209 ts_manager.cc:194] Registered new tserver with Master: 072d0541de344224a3d14d118892594d (127.8.51.65:36407)
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:23.756125 12209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:56251
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:23.772809 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:23.898422 12422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:23.898643 12422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:23.898707 12422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:23.902570 12422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:23.902621 12422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:23.902730 12422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:23.907524 12422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:23.908538 12422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:23.909507 12422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:23.918841 12430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:23.918866 12427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:23.918959 12422 server_base.cc:1034] running on GCE node
W20260809 07:58:23.918789 12428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:23.919463 12422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:23.920018 12422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:23.921175 12422 hybrid_clock.cc:648] HybridClock initialized: now 1786262303921142 us; error 45 us; skew 500 ppm
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:23.924050 12422 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:23.924892 12422 webserver.cc:460] Webserver started at http://127.8.51.66:41755/ using document root <none> and password file <none>
I20260809 07:58:23.925452 12422 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:23.925511 12422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:23.925782 12422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:23.927753 12422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "372bd5f29d734d288d4b0727dc2b0de4"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "069b573d5de0175f728299748b422881"
server_key_iv: "f0053b9302f8a4336ad6a6e43fa0102d"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.928336 12422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "372bd5f29d734d288d4b0727dc2b0de4"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "069b573d5de0175f728299748b422881"
server_key_iv: "f0053b9302f8a4336ad6a6e43fa0102d"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.931963 12422 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 07:58:23.934466 12440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.935711 12422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 07:58:23.935827 12422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "372bd5f29d734d288d4b0727dc2b0de4"
format_stamp: "Formatted at 2026-08-09 07:58:23 on dist-test-slave-njxd"
server_key: "069b573d5de0175f728299748b422881"
server_key_iv: "f0053b9302f8a4336ad6a6e43fa0102d"
server_key_version: "encryptionkey@0"
I20260809 07:58:23.935930 12422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:23.962085 12422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:23.964860 12422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:23.965050 12422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:23.965683 12422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:23.966495 12422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:23.966538 12422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.966601 12422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:23.966642 12422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:23.975068 12422 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:39955
I20260809 07:58:23.975104 12564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:39955 every 8 connection(s)
I20260809 07:58:23.975924 12422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:23.979189 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12422
I20260809 07:58:23.979293 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:23.979573 8397 external_mini_cluster.cc:1428] Setting key 2cb17d1777ca3d7558a8b35ea16802ab
Aug 09 07:58:23 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262303, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:58:23.990224 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:23.977667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:39683 (local address 127.8.51.126:38149)
0809 07:58:23.977812 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:23.977815 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:23.978610 (+ 795us) server_negotiation.cc:407] Connection header received
0809 07:58:23.980149 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:23.980153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:23.980205 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:23.980292 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:23.981637 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.982448 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.983600 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.983934 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.984105 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:23.986593 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:23.986596 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:23.986599 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:23.986633 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:23.988027 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.988555 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.988558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.988560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.988640 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:23.988983 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:23.988986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:23.988987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:23.989185 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:23.989331 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:23.989957 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 07:58:23.990075 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 07:58:23.991307 12567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:23.978036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38149 (local address 127.8.51.66:39683)
0809 07:58:23.978451 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:23.978508 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:23.979872 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:23.980471 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:23.980480 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:23.980991 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:23.981462 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:23.981476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.982565 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.982568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:23.983470 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:23.983479 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:23.984144 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:23.984149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:23.984324 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:23.984951 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:23.984966 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:23.986426 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:23.988143 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:23.988149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:23.988191 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:23.988451 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:23.988749 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:23.988752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:23.988754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:23.988885 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:23.989332 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:23.989339 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:23.989663 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 07:58:23.989913 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 07:58:23.990238 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":103,"threads_started":1}
I20260809 07:58:23.992463 12565 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38149
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:23.992723 12565 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:23.993196 12565 heartbeater.cc:511] Master 127.8.51.126:38149 requested a full tablet report, sending...
I20260809 07:58:23.994302 12209 ts_manager.cc:194] Registered new tserver with Master: 372bd5f29d734d288d4b0727dc2b0de4 (127.8.51.66:39955)
I20260809 07:58:23.995155 12209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:39683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:24.008111 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:24.118458 12570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:24.118702 12570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:24.118745 12570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:24.122617 12570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:24.122670 12570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:24.122727 12570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:24.127995 12570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:24.129001 12570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:24.130013 12570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:24.139575 12576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:24.139575 12575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:24.139595 12578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:24.139990 12570 server_base.cc:1034] running on GCE node
I20260809 07:58:24.140395 12570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:24.140969 12570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:24.142177 12570 hybrid_clock.cc:648] HybridClock initialized: now 1786262304142163 us; error 29 us; skew 500 ppm
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262304, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:24.144999 12570 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:24.145937 12570 webserver.cc:460] Webserver started at http://127.8.51.67:36153/ using document root <none> and password file <none>
I20260809 07:58:24.146524 12570 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:24.146613 12570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:24.146833 12570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:24.148854 12570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "ef0094f44ab446a1b719e1ab656e0a3a"
format_stamp: "Formatted at 2026-08-09 07:58:24 on dist-test-slave-njxd"
server_key: "ea5c01dcdf964cc26de9b03a0327de3a"
server_key_iv: "fc50307a6d3012820879adf12d225150"
server_key_version: "encryptionkey@0"
I20260809 07:58:24.149401 12570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "ef0094f44ab446a1b719e1ab656e0a3a"
format_stamp: "Formatted at 2026-08-09 07:58:24 on dist-test-slave-njxd"
server_key: "ea5c01dcdf964cc26de9b03a0327de3a"
server_key_iv: "fc50307a6d3012820879adf12d225150"
server_key_version: "encryptionkey@0"
I20260809 07:58:24.153124 12570 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 07:58:24.155690 12585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:24.156877 12570 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:24.157003 12570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "ef0094f44ab446a1b719e1ab656e0a3a"
format_stamp: "Formatted at 2026-08-09 07:58:24 on dist-test-slave-njxd"
server_key: "ea5c01dcdf964cc26de9b03a0327de3a"
server_key_iv: "fc50307a6d3012820879adf12d225150"
server_key_version: "encryptionkey@0"
I20260809 07:58:24.157116 12570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:24.168661 12570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:24.171746 12570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:24.171929 12570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:24.172503 12570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:24.173309 12570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:24.173378 12570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:24.173441 12570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:24.173488 12570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:24.182319 12570 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:44137
I20260809 07:58:24.182350 12711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:44137 every 8 connection(s)
I20260809 07:58:24.183171 12570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:24.184914 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12570
I20260809 07:58:24.185056 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:24.185362 8397 external_mini_cluster.cc:1428] Setting key c0762bf6f5bc66e847c39a10290df410
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262304, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:24.196691 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:24.184841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:34371 (local address 127.8.51.126:38149)
0809 07:58:24.184968 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:24.184991 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:24.186066 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 07:58:24.187771 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:24.187774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:24.187829 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:24.187904 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:24.189069 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.189757 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.190934 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.191158 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.191261 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:24.193565 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:24.193568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:24.193582 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:24.193623 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:24.194776 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.195257 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.195262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.195264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.195346 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.195684 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.195687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.195689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.195875 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:24.195971 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:24.196407 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 07:58:24.196525 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 07:58:24.197377 12714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:24.185349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38149 (local address 127.8.51.67:34371)
0809 07:58:24.185918 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:24.185976 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:24.187567 (+ 1591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:24.188071 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:24.188077 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:24.188427 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:24.188939 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:24.188953 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.189871 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.189874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:24.190818 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:24.190827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.191297 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.191301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:24.191474 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:24.191972 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:24.191986 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:24.193406 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:24.194888 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:24.194894 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:24.194907 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:24.195150 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:24.195441 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:24.195443 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:24.195445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:24.195585 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:24.195971 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:24.195978 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:24.196196 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 07:58:24.196363 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 07:58:24.196641 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":172,"threads_started":1}
I20260809 07:58:24.198439 12712 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38149
I20260809 07:58:24.198664 12712 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:24.199105 12712 heartbeater.cc:511] Master 127.8.51.126:38149 requested a full tablet report, sending...
I20260809 07:58:24.200095 12207 ts_manager.cc:194] Registered new tserver with Master: ef0094f44ab446a1b719e1ab656e0a3a (127.8.51.67:44137)
I20260809 07:58:24.200630 12207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:34371
I20260809 07:58:24.210487 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:24.236465 12720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:24.227696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41156 (local address 127.8.51.65:36407)
0809 07:58:24.227981 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:24.227997 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:24.228023 (+ 26us) server_negotiation.cc:407] Connection header received
0809 07:58:24.228074 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:24.228079 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:24.228272 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:24.228396 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:24.229035 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.229872 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.230671 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.231021 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.231098 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:24.233406 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:24.233415 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:24.233429 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:24.233450 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:24.234951 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.235327 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.235332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.235333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.235409 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.235623 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.235625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.235626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.235861 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:24.236022 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:24.236149 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 07:58:24.236265 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":68,"threads_started":1}
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:24.247032 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:24.239229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.8.51.126:38149)
0809 07:58:24.239409 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:24.239414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:24.239496 (+ 82us) server_negotiation.cc:407] Connection header received
0809 07:58:24.239643 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:24.239646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:24.239696 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:24.239776 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:24.240405 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.240878 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.241614 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:24.241849 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:24.241949 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:24.244206 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:24.244210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:24.244212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:24.244236 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:24.245402 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.245848 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.245851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.245853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.245928 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:24.246183 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:24.246203 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:24.246205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:24.246410 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:24.246544 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:24.246760 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 07:58:24.246875 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 07:58:24.247413 12207 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43164
I20260809 07:58:24.247949 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12274
I20260809 07:58:24.254918 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12422
I20260809 07:58:24.262037 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12570
I20260809 07:58:24.268255 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12174
2026-08-09T07:58:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2150 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12725](info): set up 2 sockets
Aug 09 07:58:24 dist-test-slave-njxd krb5kdc[12725](info): commencing operation
krb5kdc: starting...
W20260809 07:58:25.322983 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:25 dist-test-slave-njxd krb5kdc[12725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:25.445020 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43055
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:37977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:43055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:25.557840 12739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:25.558147 12739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:25.558257 12739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:25.562381 12739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:25.562461 12739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:25.562501 12739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:25.562562 12739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:25.562602 12739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:25.567796 12739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:37977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:43055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:25.568863 12739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:25.569988 12739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 07:58:25.578298 12739 server_base.cc:1034] running on GCE node
W20260809 07:58:25.578224 12747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:25.578317 12751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:25.578224 12748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:25.579051 12739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:25.580107 12739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:25.581290 12739 hybrid_clock.cc:648] HybridClock initialized: now 1786262305581270 us; error 29 us; skew 500 ppm
Aug 09 07:58:25 dist-test-slave-njxd krb5kdc[12725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262305, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:25.588176 12739 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:25.588910 12739 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:25.589004 12739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:25.589237 12739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:25.591270 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "226119f004854c2080e262144e55a159"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "e0c37a23165556798a857a0021bf0eab"
server_key_iv: "438c3b28cbc005e96e28fc6afbcdc601"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.591815 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "226119f004854c2080e262144e55a159"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "e0c37a23165556798a857a0021bf0eab"
server_key_iv: "438c3b28cbc005e96e28fc6afbcdc601"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.595430 12739 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 07:58:25.597716 12758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:25.598843 12739 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:25.598978 12739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "226119f004854c2080e262144e55a159"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "e0c37a23165556798a857a0021bf0eab"
server_key_iv: "438c3b28cbc005e96e28fc6afbcdc601"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.599082 12739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:25.626109 12739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:25.629544 12739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:25.629797 12739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:25.636639 12739 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:43055
I20260809 07:58:25.636895 12816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:43055 every 8 connection(s)
I20260809 07:58:25.637331 12739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:25.640147 12818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:25.642004 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12739
I20260809 07:58:25.642133 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:25.642432 8397 external_mini_cluster.cc:1428] Setting key cae950093c7f7c53a0af502a0b952481
I20260809 07:58:25.647243 12818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: Bootstrap starting.
I20260809 07:58:25.649943 12818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:25.650740 12818 log.cc:824] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: Log is configured to *not* fsync() on all Append() calls
Aug 09 07:58:25 dist-test-slave-njxd krb5kdc[12725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:25.652850 12818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: No bootstrap required, opened a new log
I20260809 07:58:25.657684 12818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } }
I20260809 07:58:25.658010 12818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:25.658133 12818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 226119f004854c2080e262144e55a159, State: Initialized, Role: FOLLOWER
I20260809 07:58:25.658468 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:25.643951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.8.51.126:43055)
0809 07:58:25.644388 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:25.644408 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:25.644451 (+ 43us) server_negotiation.cc:407] Connection header received
0809 07:58:25.645320 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:25.645346 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:25.645838 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:25.646216 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:25.646938 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.648323 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.649226 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.649951 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.650123 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:25.652926 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:25.652933 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:25.652950 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:25.652981 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:25.654988 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:25.655439 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:25.655449 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:25.655456 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:25.655628 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:25.655974 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:25.655977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:25.655979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:25.656493 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:25.656746 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:25.657054 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 07:58:25.657359 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":116,"threads_started":1}
I20260809 07:58:25.658638 12818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } }
I20260809 07:58:25.658793 12818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:25.658895 12818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:25.659013 12818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:25.660071 12818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } }
I20260809 07:58:25.660431 12818 leader_election.cc:302] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 226119f004854c2080e262144e55a159; no voters:
I20260809 07:58:25.660758 12818 leader_election.cc:288] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:25.660899 12823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:25.661152 12823 raft_consensus.cc:686] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [term 1 LEADER]: Becoming Leader. State: Replica: 226119f004854c2080e262144e55a159, State: Running, Role: LEADER
I20260809 07:58:25.661513 12823 consensus_queue.cc:237] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } }
I20260809 07:58:25.662034 12818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:25.663283 12824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 226119f004854c2080e262144e55a159. Latest consensus state: current_term: 1 leader_uuid: "226119f004854c2080e262144e55a159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } } }
I20260809 07:58:25.663426 12824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:25.663293 12825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "226119f004854c2080e262144e55a159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226119f004854c2080e262144e55a159" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43055 } } }
I20260809 07:58:25.663527 12825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159 [sys.catalog]: This master's current role is: LEADER
W20260809 07:58:25.666882 12839 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:25.667024 12839 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:25.667171 12833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:25.668076 12833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:25.673462 12833 catalog_manager.cc:1347] Generated new cluster ID: 69325ff24cd143ccbccd705e2ea7dfaf
I20260809 07:58:25.673525 12833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:25.693503 12833 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:25.694388 12833 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:25.710496 12833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: Generated new TSK 0
I20260809 07:58:25.711181 12833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:25.741254 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:37977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:25.848188 12847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:25.848424 12847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:25.848466 12847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:25.852362 12847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:25.852416 12847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:25.852510 12847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:25.857698 12847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:37977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:25.858626 12847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:25.859615 12847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:25.868882 12853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:25.868880 12852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:25.868927 12847 server_base.cc:1034] running on GCE node
W20260809 07:58:25.868880 12855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:25.869522 12847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:25.870182 12847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:25.871498 12847 hybrid_clock.cc:648] HybridClock initialized: now 1786262305871485 us; error 28 us; skew 500 ppm
Aug 09 07:58:25 dist-test-slave-njxd krb5kdc[12725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262305, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:25.874325 12847 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:25.875423 12847 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:25.875527 12847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:25.875762 12847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:25.877846 12847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "d07f4b0571bb494dbaf314fa7b827155"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "0b806102063cd1936849d0691bb30831"
server_key_iv: "7a6bfa95ff7df4677230793ac22cc4f2"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.878410 12847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "d07f4b0571bb494dbaf314fa7b827155"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "0b806102063cd1936849d0691bb30831"
server_key_iv: "7a6bfa95ff7df4677230793ac22cc4f2"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.881933 12847 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 07:58:25.884204 12861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:25.885326 12847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:25.885435 12847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "d07f4b0571bb494dbaf314fa7b827155"
format_stamp: "Formatted at 2026-08-09 07:58:25 on dist-test-slave-njxd"
server_key: "0b806102063cd1936849d0691bb30831"
server_key_iv: "7a6bfa95ff7df4677230793ac22cc4f2"
server_key_version: "encryptionkey@0"
I20260809 07:58:25.885528 12847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:25.909767 12847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:25.913117 12847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:25.913329 12847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:25.913957 12847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:25.914815 12847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:25.914888 12847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:25.914961 12847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:25.915017 12847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:25.923833 12847 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:34729
I20260809 07:58:25.923856 12987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:34729 every 8 connection(s)
I20260809 07:58:25.924430 12847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:25.927556 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12847
I20260809 07:58:25.927749 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:25.928133 8397 external_mini_cluster.cc:1428] Setting key 21aa4b282c16fbb94263fa433199221b
Aug 09 07:58:25 dist-test-slave-njxd krb5kdc[12725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262305, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:25.939270 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:25.926245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:40415 (local address 127.8.51.126:43055)
0809 07:58:25.926421 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:25.926426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:25.927255 (+ 829us) server_negotiation.cc:407] Connection header received
0809 07:58:25.928991 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:25.928994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:25.929036 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:25.929103 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:25.930599 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.931104 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.932406 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.932823 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.932945 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:25.935473 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:25.935478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:25.935482 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:25.935519 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:25.937231 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:25.937765 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:25.937769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:25.937771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:25.937866 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:25.938211 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:25.938214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:25.938216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:25.938434 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:25.938538 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:25.939035 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 07:58:25.939141 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 07:58:25.940059 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:25.926645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43055 (local address 127.8.51.65:40415)
0809 07:58:25.927082 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:25.927135 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:25.928762 (+ 1627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:25.929280 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:25.929288 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:25.929768 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:25.930443 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:25.930465 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.931228 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.931235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:25.932245 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:25.932258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:25.932965 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:25.932967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:25.933108 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:25.933762 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:25.933778 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:25.935301 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:25.937344 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:25.937348 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:25.937359 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:25.937663 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:25.937972 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:25.937974 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:25.937975 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:25.938099 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:25.938530 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:25.938535 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:25.938803 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 07:58:25.938953 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 07:58:25.939194 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:25.941447 12988 heartbeater.cc:347] Connected to a master server at 127.8.51.126:43055
I20260809 07:58:25.941722 12988 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:25.942188 12988 heartbeater.cc:511] Master 127.8.51.126:43055 requested a full tablet report, sending...
I20260809 07:58:25.943768 12775 ts_manager.cc:194] Registered new tserver with Master: d07f4b0571bb494dbaf314fa7b827155 (127.8.51.65:34729)
I20260809 07:58:25.944852 12775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:40415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:25.956161 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:37977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:26.066720 12993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:26.066972 12993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:26.067015 12993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:26.071048 12993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:26.071128 12993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:26.071201 12993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:26.076385 12993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:37977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:26.077318 12993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:26.078277 12993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:26.087805 12999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:26.087811 12998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:26.087950 12993 server_base.cc:1034] running on GCE node
W20260809 07:58:26.087811 13001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:26.088538 12993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:26.089250 12993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:26.090417 12993 hybrid_clock.cc:648] HybridClock initialized: now 1786262306090375 us; error 53 us; skew 500 ppm
Aug 09 07:58:26 dist-test-slave-njxd krb5kdc[12725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262306, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:26.093315 12993 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:26.094126 12993 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:26.094193 12993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:26.094414 12993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:26.096451 12993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "ec2379c414fe4af38c1968a8b93444a4"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "9c8a6f6729cd1f0b0aca58825b855664"
server_key_iv: "ec60672c6f195a52bce3a75ce258d6f9"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.097023 12993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "ec2379c414fe4af38c1968a8b93444a4"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "9c8a6f6729cd1f0b0aca58825b855664"
server_key_iv: "ec60672c6f195a52bce3a75ce258d6f9"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.100893 12993 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 07:58:26.103506 13007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.104702 12993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 07:58:26.104828 12993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ec2379c414fe4af38c1968a8b93444a4"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "9c8a6f6729cd1f0b0aca58825b855664"
server_key_iv: "ec60672c6f195a52bce3a75ce258d6f9"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.104934 12993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:26.116322 12993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:26.118966 12993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:26.119154 12993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:26.119675 12993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:26.120388 12993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:26.120481 12993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.120554 12993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:26.120595 12993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.129366 12993 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:39925
I20260809 07:58:26.129395 13126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:39925 every 8 connection(s)
I20260809 07:58:26.129952 12993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:26.132900 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 12993
I20260809 07:58:26.133081 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:26.133417 8397 external_mini_cluster.cc:1428] Setting key b6a0454d03e7352120e072a871af7c4e
Aug 09 07:58:26 dist-test-slave-njxd krb5kdc[12725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262306, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:58:26.144801 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.131618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:59635 (local address 127.8.51.126:43055)
0809 07:58:26.131776 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.131781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.132652 (+ 871us) server_negotiation.cc:407] Connection header received
0809 07:58:26.134243 (+ 1591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.134247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.134298 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.134384 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:26.135888 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.136354 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.137648 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.138067 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.138192 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.140995 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:26.141001 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:26.141007 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:26.141043 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:26.142827 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.143319 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.143323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.143325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.143426 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.143760 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.143766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.143770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.143990 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:26.144088 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.144588 (+ 500us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.144686 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 07:58:26.145682 13129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.132000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43055 (local address 127.8.51.66:59635)
0809 07:58:26.132469 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.132509 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.134040 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.134571 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.134577 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.135035 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:26.135723 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.135745 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.136471 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.136477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.137475 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.137484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.138305 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.138308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.138450 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.139077 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:26.139092 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:26.140819 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:26.142940 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:26.142944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:26.142956 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:26.143212 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:26.143528 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:26.143530 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:26.143531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:26.143663 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:26.144086 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:26.144091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:26.144354 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.144505 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.144738 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":113,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:26.146847 13127 heartbeater.cc:347] Connected to a master server at 127.8.51.126:43055
I20260809 07:58:26.147034 13127 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:26.147542 13127 heartbeater.cc:511] Master 127.8.51.126:43055 requested a full tablet report, sending...
I20260809 07:58:26.148718 12775 ts_manager.cc:194] Registered new tserver with Master: ec2379c414fe4af38c1968a8b93444a4 (127.8.51.66:39925)
I20260809 07:58:26.149307 12775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:59635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:26.162602 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:37977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:26.270366 13132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:26.270596 13132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:26.270646 13132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:26.274511 13132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:26.274592 13132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:26.274653 13132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:26.279578 13132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:37977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:26.280506 13132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:26.281466 13132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:26.290975 13137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:26.291015 13132 server_base.cc:1034] running on GCE node
W20260809 07:58:26.290980 13138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:26.290985 13140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:26.291605 13132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:26.292172 13132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:26.293349 13132 hybrid_clock.cc:648] HybridClock initialized: now 1786262306293353 us; error 42 us; skew 500 ppm
Aug 09 07:58:26 dist-test-slave-njxd krb5kdc[12725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262306, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:26.296056 13132 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:26.296744 13132 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:26.296833 13132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:26.297031 13132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:26.299149 13132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "db60a4fd886f48b89eab467f9c07d19a"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "d506ef6051bed6b9b5a5beef9a596947"
server_key_iv: "51f1718de50e32d30746daa6461e1200"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.299723 13132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "db60a4fd886f48b89eab467f9c07d19a"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "d506ef6051bed6b9b5a5beef9a596947"
server_key_iv: "51f1718de50e32d30746daa6461e1200"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.303229 13132 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 07:58:26.305428 13147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.306634 13132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:26.306761 13132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "db60a4fd886f48b89eab467f9c07d19a"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "d506ef6051bed6b9b5a5beef9a596947"
server_key_iv: "51f1718de50e32d30746daa6461e1200"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.306861 13132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:26.326051 13132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:26.328621 13132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:26.328814 13132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:26.329429 13132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:26.330230 13132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:26.330310 13132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.330384 13132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:26.330420 13132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.338740 13132 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36795
I20260809 07:58:26.338770 13276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36795 every 8 connection(s)
I20260809 07:58:26.339287 13132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
Aug 09 07:58:26 dist-test-slave-njxd krb5kdc[12725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262306, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:26.348855 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13132
I20260809 07:58:26.348994 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:26.349395 8397 external_mini_cluster.cc:1428] Setting key ff2cc54a7b94fc939f8f94c5b073436d
I20260809 07:58:26.352399 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.340944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37069 (local address 127.8.51.126:43055)
0809 07:58:26.341087 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.341091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.341921 (+ 830us) server_negotiation.cc:407] Connection header received
0809 07:58:26.343200 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.343203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.343258 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.343348 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:26.344501 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.345022 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.346126 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.346347 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.346464 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.348736 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:26.348740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:26.348741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:26.348763 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:26.350386 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.350984 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.350987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.350988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.351064 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.351435 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.351440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.351444 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.351659 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:26.351739 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.352174 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.352266 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:58:26.353206 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.341285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43055 (local address 127.8.51.67:37069)
0809 07:58:26.341780 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.341819 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.342986 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.343521 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.343540 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.343899 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:26.344341 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.344353 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.345145 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.345149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.346000 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.346009 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.346513 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.346518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.346688 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.347208 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:26.347223 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:26.348553 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:26.350500 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:26.350504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:26.350516 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:26.350881 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:26.351151 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:26.351160 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:26.351162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:26.351326 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:26.351759 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:26.351763 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:26.351957 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.352122 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.352374 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":124,"threads_started":1}
I20260809 07:58:26.354307 13277 heartbeater.cc:347] Connected to a master server at 127.8.51.126:43055
I20260809 07:58:26.354544 13277 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:26.354960 13277 heartbeater.cc:511] Master 127.8.51.126:43055 requested a full tablet report, sending...
I20260809 07:58:26.355887 12775 ts_manager.cc:194] Registered new tserver with Master: db60a4fd886f48b89eab467f9c07d19a (127.8.51.67:36795)
I20260809 07:58:26.356418 12775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:37069
I20260809 07:58:26.363092 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:58:26.371068 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.365025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43994 (local address 127.8.51.126:43055)
0809 07:58:26.365123 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.365127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.365303 (+ 176us) server_negotiation.cc:407] Connection header received
0809 07:58:26.365389 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.365391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.365423 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.365480 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:26.366132 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.366572 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.367267 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.367436 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.367498 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.368630 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:26.368633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:26.368635 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:26.368654 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:26.369830 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.370197 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.370199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.370200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.370267 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:26.370483 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:26.370484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:26.370485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:26.370656 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:26.370749 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.370892 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.370968 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 07:58:26.373546 12775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:26.376616 12775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:26.390543 13294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.385265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46842 (local address 127.8.51.67:36795)
0809 07:58:26.385977 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.385988 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.386008 (+ 20us) server_negotiation.cc:407] Connection header received
0809 07:58:26.386077 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.386082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.386288 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.386451 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:26.386694 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387367 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.388980 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.389852 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.389979 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.390136 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.390294 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.390386 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":137,"threads_started":1}
I20260809 07:58:26.390559 13290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.384491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36795 (local address 127.0.0.1:46842)
0809 07:58:26.385249 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.385297 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.385439 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.386439 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.386442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.386460 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:26.386567 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.386577 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387487 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.387493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.388852 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.388863 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.389989 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.389992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.390105 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.390138 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.390265 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.390416 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":3,"spinlock_wait_cycles":12800,"thread_start_us":94,"threads_started":1}
I20260809 07:58:26.390594 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.384435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:39925 (local address 127.0.0.1:39568)
0809 07:58:26.385248 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.385298 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.385441 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.386262 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.386268 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.386291 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:26.386410 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.386416 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387942 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.387945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.389096 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.389124 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.390203 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.390206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.390289 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.390314 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.390367 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.390433 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":58,"spinlock_wait_cycles":7168,"thread_start_us":91,"threads_started":1}
I20260809 07:58:26.390908 13292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.384801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34729 (local address 127.0.0.1:41184)
0809 07:58:26.385693 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.385706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.385791 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.386402 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.386404 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.386417 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:26.386511 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.386516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387967 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.387970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.389023 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.389035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.390355 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.390361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.390435 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.390452 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.390515 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.390566 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":86,"threads_started":1}
I20260809 07:58:26.391399 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.385132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41184 (local address 127.8.51.65:34729)
0809 07:58:26.385731 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.385736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.385759 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:58:26.385937 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.385942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.386085 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.386248 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:26.386625 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387786 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.389165 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.390029 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.390165 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.390296 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.391163 (+ 867us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.391257 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":84,"threads_started":1}
I20260809 07:58:26.391546 13291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.384555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39568 (local address 127.8.51.66:39925)
0809 07:58:26.385552 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.385567 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.385621 (+ 54us) server_negotiation.cc:407] Connection header received
0809 07:58:26.385858 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.385865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.386070 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.386556 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:26.386725 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.387797 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.389256 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.390029 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.391143 (+ 1114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.391271 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.391314 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.391396 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":151,"threads_started":1}
I20260809 07:58:26.393733 13200 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b (DEFAULT_TABLE table=test-table [id=e87931898a614a4f94c0e2880aecef69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:26.393957 13057 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b (DEFAULT_TABLE table=test-table [id=e87931898a614a4f94c0e2880aecef69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:26.394248 12914 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b (DEFAULT_TABLE table=test-table [id=e87931898a614a4f94c0e2880aecef69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:26.394908 13057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac97ec5f0394efcb4b52e4833c4143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:26.394901 13200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac97ec5f0394efcb4b52e4833c4143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:26.395151 12914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac97ec5f0394efcb4b52e4833c4143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:26.400900 13295 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Bootstrap starting.
I20260809 07:58:26.402518 13297 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Bootstrap starting.
I20260809 07:58:26.403115 13295 tablet_bootstrap.cc:654] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:26.404083 13295 log.cc:824] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:26.404361 13297 tablet_bootstrap.cc:654] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:26.405069 13296 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Bootstrap starting.
I20260809 07:58:26.405462 13297 log.cc:824] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:26.406205 13295 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: No bootstrap required, opened a new log
I20260809 07:58:26.406396 13295 ts_tablet_manager.cc:1397] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:58:26.407153 13296 tablet_bootstrap.cc:654] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:26.407289 13297 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: No bootstrap required, opened a new log
I20260809 07:58:26.407466 13297 ts_tablet_manager.cc:1397] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:26.408236 13296 log.cc:824] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:26.409976 13296 tablet_bootstrap.cc:492] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: No bootstrap required, opened a new log
I20260809 07:58:26.410156 13296 ts_tablet_manager.cc:1397] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:26.410368 13295 raft_consensus.cc:348] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.410645 13295 raft_consensus.cc:374] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:26.410712 13295 raft_consensus.cc:729] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec2379c414fe4af38c1968a8b93444a4, State: Initialized, Role: FOLLOWER
I20260809 07:58:26.411149 13295 consensus_queue.cc:260] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.411264 13297 raft_consensus.cc:348] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.411505 13297 raft_consensus.cc:374] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:26.411574 13297 raft_consensus.cc:729] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07f4b0571bb494dbaf314fa7b827155, State: Initialized, Role: FOLLOWER
I20260809 07:58:26.411988 13127 heartbeater.cc:503] Master 127.8.51.126:43055 was elected leader, sending a full tablet report...
I20260809 07:58:26.412043 13297 consensus_queue.cc:260] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.412199 13295 ts_tablet_manager.cc:1428] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 07:58:26.412863 13297 ts_tablet_manager.cc:1428] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 07:58:26.413156 12988 heartbeater.cc:503] Master 127.8.51.126:43055 was elected leader, sending a full tablet report...
I20260809 07:58:26.413919 13296 raft_consensus.cc:348] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.414232 13296 raft_consensus.cc:374] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:26.414296 13296 raft_consensus.cc:729] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db60a4fd886f48b89eab467f9c07d19a, State: Initialized, Role: FOLLOWER
I20260809 07:58:26.414726 13296 consensus_queue.cc:260] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.415561 13277 heartbeater.cc:503] Master 127.8.51.126:43055 was elected leader, sending a full tablet report...
I20260809 07:58:26.415639 13296 ts_tablet_manager.cc:1428] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 07:58:26.425571 12989 tablet.cc:2369] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:26.590184 13278 tablet.cc:2369] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:26.612568 13301 raft_consensus.cc:482] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:26.612771 13301 raft_consensus.cc:504] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.613992 13301 leader_election.cc:288] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db60a4fd886f48b89eab467f9c07d19a (127.8.51.67:36795), d07f4b0571bb494dbaf314fa7b827155 (127.8.51.65:34729)
I20260809 07:58:26.617913 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.614444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53727 (local address 127.8.51.65:34729)
0809 07:58:26.614604 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.614609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.614626 (+ 17us) server_negotiation.cc:407] Connection header received
0809 07:58:26.614689 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.614691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.614729 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.614817 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:26.615111 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.615617 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.616706 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.617302 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.617420 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.617488 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.617692 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.617776 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:26.617920 13129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.614270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34729 (local address 127.8.51.66:53727)
0809 07:58:26.614403 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.614419 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.614540 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.614830 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.614833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.614877 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:26.614988 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.614993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.615734 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.615739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.616557 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.616569 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.617421 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.617424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.617534 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.617561 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.617664 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.617748 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":1,"spinlock_wait_cycles":31232}
I20260809 07:58:26.618435 13305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.614282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36795 (local address 127.8.51.66:57779)
0809 07:58:26.614730 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.614741 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:26.614894 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:26.615163 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:26.615166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:26.615182 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:26.615303 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.615309 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.616021 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.616026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.617040 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:26.617050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.617958 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.617964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:26.618066 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.618098 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 07:58:26.618208 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 07:58:26.618275 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":125,"spinlock_wait_cycles":6400,"thread_start_us":108,"threads_started":1}
I20260809 07:58:26.618439 13294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.614381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:57779 (local address 127.8.51.67:36795)
0809 07:58:26.614546 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.614553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.614824 (+ 271us) server_negotiation.cc:407] Connection header received
0809 07:58:26.615002 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.615005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.615056 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.615134 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:26.615410 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.615905 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.617197 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.617830 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.617948 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.618010 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.618236 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.618315 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 07:58:26.618655 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac97ec5f0394efcb4b52e4833c4143b" candidate_uuid: "ec2379c414fe4af38c1968a8b93444a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07f4b0571bb494dbaf314fa7b827155" is_pre_election: true
I20260809 07:58:26.618983 12936 raft_consensus.cc:2454] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2379c414fe4af38c1968a8b93444a4 in term 0.
I20260809 07:58:26.619074 13222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac97ec5f0394efcb4b52e4833c4143b" candidate_uuid: "ec2379c414fe4af38c1968a8b93444a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db60a4fd886f48b89eab467f9c07d19a" is_pre_election: true
I20260809 07:58:26.619392 13222 raft_consensus.cc:2454] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2379c414fe4af38c1968a8b93444a4 in term 0.
I20260809 07:58:26.619521 13012 leader_election.cc:302] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d07f4b0571bb494dbaf314fa7b827155, ec2379c414fe4af38c1968a8b93444a4; no voters:
I20260809 07:58:26.619833 13301 raft_consensus.cc:2781] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:26.619921 13301 raft_consensus.cc:482] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:26.619964 13301 raft_consensus.cc:3037] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:26.621006 13301 raft_consensus.cc:504] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.621356 13301 leader_election.cc:288] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [CANDIDATE]: Term 1 election: Requested vote from peers db60a4fd886f48b89eab467f9c07d19a (127.8.51.67:36795), d07f4b0571bb494dbaf314fa7b827155 (127.8.51.65:34729)
I20260809 07:58:26.621660 13222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac97ec5f0394efcb4b52e4833c4143b" candidate_uuid: "ec2379c414fe4af38c1968a8b93444a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db60a4fd886f48b89eab467f9c07d19a"
I20260809 07:58:26.621800 13222 raft_consensus.cc:3037] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:26.621831 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac97ec5f0394efcb4b52e4833c4143b" candidate_uuid: "ec2379c414fe4af38c1968a8b93444a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07f4b0571bb494dbaf314fa7b827155"
I20260809 07:58:26.621940 12936 raft_consensus.cc:3037] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:26.623204 12936 raft_consensus.cc:2454] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2379c414fe4af38c1968a8b93444a4 in term 1.
I20260809 07:58:26.623204 13222 raft_consensus.cc:2454] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2379c414fe4af38c1968a8b93444a4 in term 1.
I20260809 07:58:26.623522 13011 leader_election.cc:302] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db60a4fd886f48b89eab467f9c07d19a, ec2379c414fe4af38c1968a8b93444a4; no voters:
I20260809 07:58:26.623695 13301 raft_consensus.cc:2781] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:26.623966 13301 raft_consensus.cc:686] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 1 LEADER]: Becoming Leader. State: Replica: ec2379c414fe4af38c1968a8b93444a4, State: Running, Role: LEADER
I20260809 07:58:26.624411 13301 consensus_queue.cc:237] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } }
I20260809 07:58:26.627938 12773 catalog_manager.cc:5495] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec2379c414fe4af38c1968a8b93444a4 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "ec2379c414fe4af38c1968a8b93444a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2379c414fe4af38c1968a8b93444a4" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 } health_report { overall_health: UNKNOWN } } }
W20260809 07:58:26.630980 13128 tablet.cc:2369] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:26.682448 13291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.679264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39572 (local address 127.8.51.66:39925)
0809 07:58:26.679395 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.679398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.679410 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:26.679487 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.679489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.679543 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.679631 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:26.679859 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.680311 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.681075 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:26.681269 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:26.681338 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:26.681647 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:26.682079 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:26.682174 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.682274 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.682323 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:26.688517 12936 raft_consensus.cc:1261] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155 [term 1 FOLLOWER]: Refusing update from remote peer ec2379c414fe4af38c1968a8b93444a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:26.688517 13222 raft_consensus.cc:1261] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 1 FOLLOWER]: Refusing update from remote peer ec2379c414fe4af38c1968a8b93444a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:26.689224 13301 consensus_queue.cc:1035] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d07f4b0571bb494dbaf314fa7b827155" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:26.689507 13306 consensus_queue.cc:1035] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db60a4fd886f48b89eab467f9c07d19a" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:26.698644 13310 mvcc.cc:205] Tried to move back new op lower bound from 7316530408188841984 to 7316530407936561152. Current Snapshot: MvccSnapshot[applied={T|T < 7316530408188841984}]
I20260809 07:58:26.708312 12774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:26.708492 12774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:26.711083 12774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 226119f004854c2080e262144e55a159: Sending DeleteTablet for 3 replicas of tablet 1ac97ec5f0394efcb4b52e4833c4143b
I20260809 07:58:26.711854 13057 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:26 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:39568
I20260809 07:58:26.711863 13200 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:26 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46842
I20260809 07:58:26.712353 13321 tablet_replica.cc:330] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: stopping tablet replica
I20260809 07:58:26.712349 13320 tablet_replica.cc:330] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: stopping tablet replica
I20260809 07:58:26.712515 12914 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ac97ec5f0394efcb4b52e4833c4143b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:26 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:41184
I20260809 07:58:26.712695 13321 raft_consensus.cc:2229] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:26.712852 13320 raft_consensus.cc:2229] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:26.713004 13321 raft_consensus.cc:2258] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:26.713485 13320 raft_consensus.cc:2258] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:26.713651 13322 tablet_replica.cc:330] T 1ac97ec5f0394efcb4b52e4833c4143b P d07f4b0571bb494dbaf314fa7b827155: stopping tablet replica
I20260809 07:58:26.713785 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12847
I20260809 07:58:26.716056 13321 ts_tablet_manager.cc:1905] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:26.718693 13321 ts_tablet_manager.cc:1918] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:26.718783 13321 log.cc:1196] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/1ac97ec5f0394efcb4b52e4833c4143b
I20260809 07:58:26.719074 13321 ts_tablet_manager.cc:1939] T 1ac97ec5f0394efcb4b52e4833c4143b P db60a4fd886f48b89eab467f9c07d19a: Deleting consensus metadata
I20260809 07:58:26.720196 12761 catalog_manager.cc:4841] TS db60a4fd886f48b89eab467f9c07d19a (127.8.51.67:36795): tablet 1ac97ec5f0394efcb4b52e4833c4143b (table test-table [id=e87931898a614a4f94c0e2880aecef69]) successfully deleted
I20260809 07:58:26.721859 13320 ts_tablet_manager.cc:1905] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:26.725219 13320 ts_tablet_manager.cc:1918] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:26.725317 13320 log.cc:1196] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/1ac97ec5f0394efcb4b52e4833c4143b
I20260809 07:58:26.725642 13320 ts_tablet_manager.cc:1939] T 1ac97ec5f0394efcb4b52e4833c4143b P ec2379c414fe4af38c1968a8b93444a4: Deleting consensus metadata
I20260809 07:58:26.726841 12760 catalog_manager.cc:4841] TS ec2379c414fe4af38c1968a8b93444a4 (127.8.51.66:39925): tablet 1ac97ec5f0394efcb4b52e4833c4143b (table test-table [id=e87931898a614a4f94c0e2880aecef69]) successfully deleted
W20260809 07:58:26.727257 12762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:34729 (error 108)
I20260809 07:58:26.727451 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12993
I20260809 07:58:26.728372 13292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.728098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34729 (local address 127.0.0.1:41188)
0809 07:58:26.728243 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:26.728300 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260809 07:58:26.728623 12762 catalog_manager.cc:4584] TS d07f4b0571bb494dbaf314fa7b827155 (127.8.51.65:34729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ac97ec5f0394efcb4b52e4833c4143b: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34729: connect: Connection refused (error 111)
I20260809 07:58:26.734659 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13132
I20260809 07:58:26.741678 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 12739
2026-08-09T07:58:26Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2474 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T07:58:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:26Z Disabled control of system clock
I20260809 07:58:26.773044 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35029
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:35029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 07:58:26.883812 13328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:26.884060 13328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:26.884099 13328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:26.888046 13328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:26.888093 13328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:26.888108 13328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:26.888124 13328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:26.888139 13328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:26.892728 13328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:35029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:26.893747 13328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:26.895081 13328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:26.903383 13334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:26.903371 13336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:26.903378 13333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:26.903535 13328 server_base.cc:1034] running on GCE node
I20260809 07:58:26.904206 13328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:26.905283 13328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:26.906473 13328 hybrid_clock.cc:648] HybridClock initialized: now 1786262306906422 us; error 62 us; skew 500 ppm
I20260809 07:58:26.908371 13328 webserver.cc:460] Webserver started at http://127.8.51.126:34975/ using document root <none> and password file <none>
I20260809 07:58:26.908946 13328 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:26.909039 13328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:26.909271 13328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:26.911340 13328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b9338b61e514407f8c9ef8e329b68415"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "911989aba1c788b2024d0b4bb8999000"
server_key_iv: "d6547bce17633661811e3dd7490b2b34"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.911908 13328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b9338b61e514407f8c9ef8e329b68415"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "911989aba1c788b2024d0b4bb8999000"
server_key_iv: "d6547bce17633661811e3dd7490b2b34"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.915545 13328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:26.917946 13342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:26.919215 13328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:26.919319 13328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b9338b61e514407f8c9ef8e329b68415"
format_stamp: "Formatted at 2026-08-09 07:58:26 on dist-test-slave-njxd"
server_key: "911989aba1c788b2024d0b4bb8999000"
server_key_iv: "d6547bce17633661811e3dd7490b2b34"
server_key_version: "encryptionkey@0"
I20260809 07:58:26.919404 13328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:26.923975 13328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:26.924535 13328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:26.924680 13328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:26.931475 13328 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:35029
I20260809 07:58:26.931478 13400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:35029 every 8 connection(s)
I20260809 07:58:26.932363 13328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:26.935582 13402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:26.938743 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13328
I20260809 07:58:26.938860 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:26.939174 8397 external_mini_cluster.cc:1428] Setting key bb33a3818beda2982867216192b3ba2a
I20260809 07:58:26.941763 13402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: Bootstrap starting.
I20260809 07:58:26.944073 13402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:26.944828 13402 log.cc:824] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:26.944839 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:26.940626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.8.51.126:35029)
0809 07:58:26.941296 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:26.941311 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:26.941345 (+ 34us) server_negotiation.cc:407] Connection header received
0809 07:58:26.942084 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:26.942102 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:26.942452 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:26.942793 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:26.943578 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:26.943582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:26.943594 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:26.943605 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:26.943665 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:26.943681 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:26.943802 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:26.943902 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 07:58:26.944164 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":136,"threads_started":1}
I20260809 07:58:26.946944 13402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: No bootstrap required, opened a new log
I20260809 07:58:26.950362 13402 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } }
I20260809 07:58:26.950565 13402 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:26.950634 13402 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9338b61e514407f8c9ef8e329b68415, State: Initialized, Role: FOLLOWER
I20260809 07:58:26.951026 13402 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } }
I20260809 07:58:26.951172 13402 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:26.951241 13402 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:26.951371 13402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:26.952351 13402 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } }
I20260809 07:58:26.952692 13402 leader_election.cc:302] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9338b61e514407f8c9ef8e329b68415; no voters:
I20260809 07:58:26.952977 13402 leader_election.cc:288] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:26.953099 13407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:26.953338 13407 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [term 1 LEADER]: Becoming Leader. State: Replica: b9338b61e514407f8c9ef8e329b68415, State: Running, Role: LEADER
I20260809 07:58:26.953709 13407 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } }
I20260809 07:58:26.954182 13402 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:26.955333 13409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9338b61e514407f8c9ef8e329b68415. Latest consensus state: current_term: 1 leader_uuid: "b9338b61e514407f8c9ef8e329b68415" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } } }
I20260809 07:58:26.955381 13408 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9338b61e514407f8c9ef8e329b68415" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9338b61e514407f8c9ef8e329b68415" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35029 } } }
I20260809 07:58:26.955466 13409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:26.955487 13408 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:26.955827 13417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:26.958941 13417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:26.965144 13417 catalog_manager.cc:1347] Generated new cluster ID: e398bb653a01431c9dae10a509ef01a0
I20260809 07:58:26.965224 13417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:26.975535 13417 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:26.975852 13417 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:26.982393 13417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: Generated new TSK 0
I20260809 07:58:26.983055 13417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:58:26.985539 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--builtin_ntp_servers=127.8.51.84:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 07:58:27.102054 13427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:27.102301 13427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:27.102377 13427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:27.106359 13427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:27.106411 13427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:27.106521 13427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:27.111320 13427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:27.112418 13427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:27.113847 13427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:27.123373 13434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:27.123454 13427 server_base.cc:1034] running on GCE node
W20260809 07:58:27.123353 13435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:27.123348 13438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:27.124053 13427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:27.124691 13427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:27.125873 13427 hybrid_clock.cc:648] HybridClock initialized: now 1786262307125861 us; error 24 us; skew 500 ppm
I20260809 07:58:27.127666 13427 webserver.cc:460] Webserver started at http://127.8.51.65:40689/ using document root <none> and password file <none>
I20260809 07:58:27.128275 13427 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:27.128374 13427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:27.128616 13427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:27.130795 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "c13f4390093e4118aef5a4724eb3790f"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "46077a78dfeef898e204acc17e16588f"
server_key_iv: "f309c05f7c4ce50a4d03d41000d4a5a3"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.131371 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "c13f4390093e4118aef5a4724eb3790f"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "46077a78dfeef898e204acc17e16588f"
server_key_iv: "f309c05f7c4ce50a4d03d41000d4a5a3"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.135253 13427 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:58:27.137684 13444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.138928 13427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:27.139065 13427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "c13f4390093e4118aef5a4724eb3790f"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "46077a78dfeef898e204acc17e16588f"
server_key_iv: "f309c05f7c4ce50a4d03d41000d4a5a3"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.139186 13427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:27.143824 13427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:27.144438 13427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:27.144622 13427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:27.145183 13427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:27.146162 13427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:27.146232 13427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.146306 13427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:27.146350 13427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.154980 13427 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:45211
I20260809 07:58:27.155045 13570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:45211 every 8 connection(s)
I20260809 07:58:27.156045 13427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:27.162281 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.157863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:39507 (local address 127.8.51.126:35029)
0809 07:58:27.158026 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.158031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.159126 (+ 1095us) server_negotiation.cc:407] Connection header received
0809 07:58:27.160622 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.160625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.160668 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.160744 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.161900 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.161903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.161905 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.161917 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.161938 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.161945 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.162018 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.162135 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.162173 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 07:58:27.162622 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13427
I20260809 07:58:27.162760 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:27.163056 8397 external_mini_cluster.cc:1428] Setting key 6c2d5052f5c4d2b2c82e86eb543c72a5
I20260809 07:58:27.163293 13573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.158324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35029 (local address 127.8.51.65:39507)
0809 07:58:27.158979 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.159019 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.160423 (+ 1404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.160898 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.160904 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.160991 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.161600 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.161603 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.161654 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.161741 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.162007 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.162011 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.162014 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.162151 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.162412 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":113,"threads_started":1}
I20260809 07:58:27.164831 13571 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35029
I20260809 07:58:27.165081 13571 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:27.165311 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--builtin_ntp_servers=127.8.51.84:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 07:58:27.165553 13571 heartbeater.cc:511] Master 127.8.51.126:35029 requested a full tablet report, sending...
I20260809 07:58:27.167132 13364 ts_manager.cc:194] Registered new tserver with Master: c13f4390093e4118aef5a4724eb3790f (127.8.51.65:45211)
W20260809 07:58:27.276903 13574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:27.277192 13574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:27.277272 13574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:27.281194 13574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:27.281291 13574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:27.281378 13574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:27.286214 13574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:27.287256 13574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:27.288589 13574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:27.297854 13585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:27.297854 13583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:27.297947 13581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:27.298058 13574 server_base.cc:1034] running on GCE node
I20260809 07:58:27.298557 13574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:27.299171 13574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:27.300333 13574 hybrid_clock.cc:648] HybridClock initialized: now 1786262307300312 us; error 30 us; skew 500 ppm
I20260809 07:58:27.302120 13574 webserver.cc:460] Webserver started at http://127.8.51.66:34123/ using document root <none> and password file <none>
I20260809 07:58:27.302695 13574 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:27.302757 13574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:27.302989 13574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:27.305049 13574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "21c24bd3993e48d2a531cd6711349c6a"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "3b691fce6dee1a68fe9e7a8f69776f15"
server_key_iv: "ed9722c8b5da00a166bb10155cec2249"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.305721 13574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "21c24bd3993e48d2a531cd6711349c6a"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "3b691fce6dee1a68fe9e7a8f69776f15"
server_key_iv: "ed9722c8b5da00a166bb10155cec2249"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.309516 13574 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:27.311964 13591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.313189 13574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 07:58:27.313313 13574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "21c24bd3993e48d2a531cd6711349c6a"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "3b691fce6dee1a68fe9e7a8f69776f15"
server_key_iv: "ed9722c8b5da00a166bb10155cec2249"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.313410 13574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:27.317970 13574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:27.318557 13574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:27.318735 13574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:27.319267 13574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:27.320271 13574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:27.320314 13574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.320351 13574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:27.320379 13574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.328892 13574 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:42127
I20260809 07:58:27.328915 13718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:42127 every 8 connection(s)
I20260809 07:58:27.329833 13574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:27.332672 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13574
I20260809 07:58:27.332809 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:27.333140 8397 external_mini_cluster.cc:1428] Setting key 114335e447c43042d4b450a5435d453f
I20260809 07:58:27.335505 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--builtin_ntp_servers=127.8.51.84:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 07:58:27.336445 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.331569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36981 (local address 127.8.51.126:35029)
0809 07:58:27.331714 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.331718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.332880 (+ 1162us) server_negotiation.cc:407] Connection header received
0809 07:58:27.334519 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.334531 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.334562 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.334680 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.335922 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.335928 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.335934 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.335949 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.335974 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.335986 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.336089 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.336214 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.336262 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 07:58:27.337167 13721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.331944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35029 (local address 127.8.51.66:36981)
0809 07:58:27.332691 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.332749 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.334300 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.334886 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.334893 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.334984 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.335586 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.335588 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.335665 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.335762 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.336079 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.336085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.336090 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.336219 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.336400 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":105,"threads_started":1}
I20260809 07:58:27.338286 13719 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35029
I20260809 07:58:27.338526 13719 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:27.338912 13719 heartbeater.cc:511] Master 127.8.51.126:35029 requested a full tablet report, sending...
I20260809 07:58:27.339977 13364 ts_manager.cc:194] Registered new tserver with Master: 21c24bd3993e48d2a531cd6711349c6a (127.8.51.66:42127)
W20260809 07:58:27.444097 13722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:27.444350 13722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:27.444389 13722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:27.448377 13722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:27.448434 13722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:27.448493 13722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:27.453176 13722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:27.454291 13722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:27.455766 13722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:27.465539 13734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:27.465548 13729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:27.465622 13728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:27.465828 13722 server_base.cc:1034] running on GCE node
I20260809 07:58:27.466352 13722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:27.466948 13722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:27.468111 13722 hybrid_clock.cc:648] HybridClock initialized: now 1786262307468099 us; error 26 us; skew 500 ppm
I20260809 07:58:27.469936 13722 webserver.cc:460] Webserver started at http://127.8.51.67:35411/ using document root <none> and password file <none>
I20260809 07:58:27.470492 13722 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:27.470552 13722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:27.470723 13722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:27.472797 13722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "35eceb4d80434916af981b64e47b4643"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "2e8933b71504e5d2fb6c90e01ac5e4bf"
server_key_iv: "4a085705bf4210297e3e9c891d015a1f"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.473328 13722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "35eceb4d80434916af981b64e47b4643"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "2e8933b71504e5d2fb6c90e01ac5e4bf"
server_key_iv: "4a085705bf4210297e3e9c891d015a1f"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.477147 13722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 07:58:27.479651 13741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.480899 13722 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:27.481007 13722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "35eceb4d80434916af981b64e47b4643"
format_stamp: "Formatted at 2026-08-09 07:58:27 on dist-test-slave-njxd"
server_key: "2e8933b71504e5d2fb6c90e01ac5e4bf"
server_key_iv: "4a085705bf4210297e3e9c891d015a1f"
server_key_version: "encryptionkey@0"
I20260809 07:58:27.481101 13722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:27.486110 13722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:27.486691 13722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:27.486828 13722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:27.487322 13722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:27.488175 13722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:27.488221 13722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.488258 13722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:27.488279 13722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:27.497026 13722 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:33617
I20260809 07:58:27.497048 13865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:33617 every 8 connection(s)
I20260809 07:58:27.497959 13722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:27.501929 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13722
I20260809 07:58:27.502030 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:27.502355 8397 external_mini_cluster.cc:1428] Setting key 04a3199d3f2ecff8d146baca30efce95
I20260809 07:58:27.504415 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.499738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:60191 (local address 127.8.51.126:35029)
0809 07:58:27.499887 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.499892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.501070 (+ 1178us) server_negotiation.cc:407] Connection header received
0809 07:58:27.502562 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.502565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.502610 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.502711 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.503956 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.503959 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.503962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.503981 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.504000 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.504008 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.504099 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.504242 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.504287 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:27.505256 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.500216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35029 (local address 127.8.51.67:60191)
0809 07:58:27.500909 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.500950 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.502329 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.502926 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.502933 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.503022 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.503705 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.503706 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.503746 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.503814 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.504089 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.504097 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.504103 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.504285 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.504521 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":100,"threads_started":1}
I20260809 07:58:27.506266 13866 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35029
I20260809 07:58:27.506498 13866 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:27.506897 13866 heartbeater.cc:511] Master 127.8.51.126:35029 requested a full tablet report, sending...
I20260809 07:58:27.507844 13364 ts_manager.cc:194] Registered new tserver with Master: 35eceb4d80434916af981b64e47b4643 (127.8.51.67:33617)
I20260809 07:58:27.516176 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:58:27.519738 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.518286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.8.51.126:35029)
0809 07:58:27.518414 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.518417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.518568 (+ 151us) server_negotiation.cc:407] Connection header received
0809 07:58:27.518671 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.518673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.518705 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.518764 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.519471 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.519474 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.519476 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.519484 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.519498 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.519505 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.519566 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.519608 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.519640 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 07:58:27.522594 13364 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:27.525813 13364 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:27.537204 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.534240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:42127 (local address 127.0.0.1:38954)
0809 07:58:27.535115 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.535131 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.535224 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.535678 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.535683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.535746 (+ 63us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.536339 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.536341 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.536365 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.536446 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.536809 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.536821 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.536829 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.536940 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.537010 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"spinlock_wait_cycles":3328,"thread_start_us":88,"threads_started":1}
I20260809 07:58:27.537693 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.534720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.8.51.66:42127)
0809 07:58:27.535219 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.535231 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.535258 (+ 27us) server_negotiation.cc:407] Connection header received
0809 07:58:27.535316 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.535322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.535528 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.535670 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.536598 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.536604 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.536617 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.536637 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.536681 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.536712 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.536820 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.537413 (+ 593us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.537495 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":107,"threads_started":1}
I20260809 07:58:27.537899 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.534720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44820 (local address 127.8.51.67:33617)
0809 07:58:27.535482 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.535493 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.535515 (+ 22us) server_negotiation.cc:407] Connection header received
0809 07:58:27.535565 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.535574 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.535757 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.535885 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.536879 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.536888 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.536903 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.536920 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.536965 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.537001 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.537091 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.537660 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.537732 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":157,"threads_started":1}
I20260809 07:58:27.538085 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.533976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:33617 (local address 127.0.0.1:44820)
0809 07:58:27.534729 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.534784 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.534876 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.535896 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.535901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.535919 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.536691 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.536693 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.536703 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.536724 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.537372 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.537375 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.537378 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.537458 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.537489 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":96,"threads_started":1}
I20260809 07:58:27.539422 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.533905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:45211 (local address 127.0.0.1:60124)
0809 07:58:27.534591 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.535127 (+ 536us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.535212 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.536941 (+ 1729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.536944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.536960 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.537829 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.537831 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.537840 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.537864 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.539181 (+ 1317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.539184 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.539187 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.539276 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.539310 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":84,"threads_started":1}
I20260809 07:58:27.539462 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.534026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60124 (local address 127.8.51.65:45211)
0809 07:58:27.536535 (+ 2509us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.536547 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.536569 (+ 22us) server_negotiation.cc:407] Connection header received
0809 07:58:27.536618 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.536625 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.536804 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.536942 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.538954 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.538962 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.538975 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.538989 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.539032 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.539062 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.539174 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.539286 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.539338 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2396,"thread_start_us":96,"threads_started":1}
I20260809 07:58:27.541213 13648 tablet_service.cc:1467] Processing CreateTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed (DEFAULT_TABLE table=test-table [id=e6470ddf3f6f4080aa430fbeb96dfc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:27.541534 13794 tablet_service.cc:1467] Processing CreateTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed (DEFAULT_TABLE table=test-table [id=e6470ddf3f6f4080aa430fbeb96dfc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:27.541966 13498 tablet_service.cc:1467] Processing CreateTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed (DEFAULT_TABLE table=test-table [id=e6470ddf3f6f4080aa430fbeb96dfc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:27.542403 13648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8fb56fe6ba41bab87af112b227e6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:27.542461 13794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8fb56fe6ba41bab87af112b227e6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:27.542904 13498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8fb56fe6ba41bab87af112b227e6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:27.548816 13883 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Bootstrap starting.
I20260809 07:58:27.550129 13885 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Bootstrap starting.
I20260809 07:58:27.551378 13883 tablet_bootstrap.cc:654] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:27.552124 13883 log.cc:824] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:27.552158 13885 tablet_bootstrap.cc:654] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:27.552809 13884 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Bootstrap starting.
I20260809 07:58:27.553000 13885 log.cc:824] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:27.554411 13883 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: No bootstrap required, opened a new log
I20260809 07:58:27.554627 13883 ts_tablet_manager.cc:1397] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:58:27.554939 13884 tablet_bootstrap.cc:654] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:27.555132 13885 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: No bootstrap required, opened a new log
I20260809 07:58:27.555310 13885 ts_tablet_manager.cc:1397] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:27.555847 13884 log.cc:824] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:27.557485 13884 tablet_bootstrap.cc:492] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: No bootstrap required, opened a new log
I20260809 07:58:27.557701 13884 ts_tablet_manager.cc:1397] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260809 07:58:27.559438 13883 raft_consensus.cc:348] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.559717 13883 raft_consensus.cc:374] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:27.559787 13883 raft_consensus.cc:729] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13f4390093e4118aef5a4724eb3790f, State: Initialized, Role: FOLLOWER
I20260809 07:58:27.559778 13885 raft_consensus.cc:348] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.560014 13885 raft_consensus.cc:374] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:27.560070 13885 raft_consensus.cc:729] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35eceb4d80434916af981b64e47b4643, State: Initialized, Role: FOLLOWER
I20260809 07:58:27.560257 13883 consensus_queue.cc:260] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.560460 13885 consensus_queue.cc:260] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.561067 13571 heartbeater.cc:503] Master 127.8.51.126:35029 was elected leader, sending a full tablet report...
I20260809 07:58:27.561404 13885 ts_tablet_manager.cc:1428] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 07:58:27.561404 13883 ts_tablet_manager.cc:1428] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260809 07:58:27.561303 13884 raft_consensus.cc:348] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.561527 13884 raft_consensus.cc:374] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:27.561611 13884 raft_consensus.cc:729] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c24bd3993e48d2a531cd6711349c6a, State: Initialized, Role: FOLLOWER
I20260809 07:58:27.561793 13866 heartbeater.cc:503] Master 127.8.51.126:35029 was elected leader, sending a full tablet report...
I20260809 07:58:27.562080 13884 consensus_queue.cc:260] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.562744 13719 heartbeater.cc:503] Master 127.8.51.126:35029 was elected leader, sending a full tablet report...
I20260809 07:58:27.564672 13884 ts_tablet_manager.cc:1428] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260809 07:58:27.580749 13720 tablet.cc:2369] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:27.657297 13572 tablet.cc:2369] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:58:27.749051 13867 tablet.cc:2369] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:27.977766 13890 raft_consensus.cc:482] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:27.977993 13890 raft_consensus.cc:504] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.979260 13890 leader_election.cc:288] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c13f4390093e4118aef5a4724eb3790f (127.8.51.65:45211), 21c24bd3993e48d2a531cd6711349c6a (127.8.51.66:42127)
I20260809 07:58:27.981184 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.979465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:45211 (local address 127.8.51.67:45649)
0809 07:58:27.979613 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.979641 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.979731 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.980091 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.980094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.980109 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.980617 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.980620 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.980634 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.980680 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.980912 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.980915 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.980917 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.981013 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.981064 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 07:58:27.981207 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.979724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:45649 (local address 127.8.51.65:45211)
0809 07:58:27.979880 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.979884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.979897 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:27.979938 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.979940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.979970 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.980071 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.980791 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.980794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.980796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.980807 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.980827 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.980836 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.980908 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.981037 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.981090 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 07:58:27.981557 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.979615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:42127 (local address 127.8.51.67:52755)
0809 07:58:27.979952 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:27.979962 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:27.980052 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:27.980299 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:27.980302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:27.980316 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:27.980962 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:58:27.980963 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:27.980971 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:58:27.980992 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:27.981248 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:27.981251 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:27.981254 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 07:58:27.981374 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 07:58:27.981415 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":85,"threads_started":1}
I20260809 07:58:27.981561 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:27.979688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:52755 (local address 127.8.51.66:42127)
0809 07:58:27.979822 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:27.979827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:27.980040 (+ 213us) server_negotiation.cc:407] Connection header received
0809 07:58:27.980146 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:27.980149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:27.980190 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:27.980279 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:27.981117 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:27.981120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:27.981122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:27.981140 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:27.981164 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:27.981171 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:27.981259 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:27.981404 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 07:58:27.981451 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:58:27.981911 13519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8fb56fe6ba41bab87af112b227e6ed" candidate_uuid: "35eceb4d80434916af981b64e47b4643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c13f4390093e4118aef5a4724eb3790f" is_pre_election: true
I20260809 07:58:27.982201 13519 raft_consensus.cc:2454] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35eceb4d80434916af981b64e47b4643 in term 0.
I20260809 07:58:27.982191 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8fb56fe6ba41bab87af112b227e6ed" candidate_uuid: "35eceb4d80434916af981b64e47b4643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c24bd3993e48d2a531cd6711349c6a" is_pre_election: true
I20260809 07:58:27.982466 13670 raft_consensus.cc:2454] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35eceb4d80434916af981b64e47b4643 in term 0.
I20260809 07:58:27.982709 13743 leader_election.cc:302] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35eceb4d80434916af981b64e47b4643, c13f4390093e4118aef5a4724eb3790f; no voters:
I20260809 07:58:27.982987 13890 raft_consensus.cc:2781] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:27.983079 13890 raft_consensus.cc:482] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:27.983137 13890 raft_consensus.cc:3037] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:27.984306 13890 raft_consensus.cc:504] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.984679 13890 leader_election.cc:288] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [CANDIDATE]: Term 1 election: Requested vote from peers c13f4390093e4118aef5a4724eb3790f (127.8.51.65:45211), 21c24bd3993e48d2a531cd6711349c6a (127.8.51.66:42127)
I20260809 07:58:27.985008 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8fb56fe6ba41bab87af112b227e6ed" candidate_uuid: "35eceb4d80434916af981b64e47b4643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c24bd3993e48d2a531cd6711349c6a"
I20260809 07:58:27.984966 13519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8fb56fe6ba41bab87af112b227e6ed" candidate_uuid: "35eceb4d80434916af981b64e47b4643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c13f4390093e4118aef5a4724eb3790f"
I20260809 07:58:27.985119 13519 raft_consensus.cc:3037] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:27.985145 13670 raft_consensus.cc:3037] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:27.986452 13519 raft_consensus.cc:2454] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35eceb4d80434916af981b64e47b4643 in term 1.
I20260809 07:58:27.986452 13670 raft_consensus.cc:2454] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35eceb4d80434916af981b64e47b4643 in term 1.
I20260809 07:58:27.986759 13745 leader_election.cc:302] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c24bd3993e48d2a531cd6711349c6a, 35eceb4d80434916af981b64e47b4643; no voters:
I20260809 07:58:27.986934 13890 raft_consensus.cc:2781] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:27.987169 13890 raft_consensus.cc:686] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 1 LEADER]: Becoming Leader. State: Replica: 35eceb4d80434916af981b64e47b4643, State: Running, Role: LEADER
I20260809 07:58:27.987504 13890 consensus_queue.cc:237] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } }
I20260809 07:58:27.990551 13362 catalog_manager.cc:5495] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35eceb4d80434916af981b64e47b4643 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "35eceb4d80434916af981b64e47b4643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35eceb4d80434916af981b64e47b4643" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:28.099923 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.098302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44826 (local address 127.8.51.67:33617)
0809 07:58:28.098554 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:28.098558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:28.098572 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:28.098714 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:28.098716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:28.098776 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:28.098856 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:28.099494 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:28.099497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:28.099499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:28.099510 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:28.099529 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:28.099537 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:28.099610 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:28.099684 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 07:58:28.099718 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":65,"threads_started":1}
I20260809 07:58:28.105738 13519 raft_consensus.cc:1261] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 1 FOLLOWER]: Refusing update from remote peer 35eceb4d80434916af981b64e47b4643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:28.105774 13670 raft_consensus.cc:1261] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 1 FOLLOWER]: Refusing update from remote peer 35eceb4d80434916af981b64e47b4643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:28.106453 13890 consensus_queue.cc:1035] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c13f4390093e4118aef5a4724eb3790f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:28.106626 13893 consensus_queue.cc:1035] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c24bd3993e48d2a531cd6711349c6a" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:28.112502 13899 mvcc.cc:205] Tried to move back new op lower bound from 7316530413994090496 to 7316530413519335424. Current Snapshot: MvccSnapshot[applied={T|T < 7316530413994090496}]
I20260809 07:58:28.116999 13903 mvcc.cc:205] Tried to move back new op lower bound from 7316530413994090496 to 7316530413519335424. Current Snapshot: MvccSnapshot[applied={T|T < 7316530413994090496}]
I20260809 07:58:28.121426 13362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:28.121620 13362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:28.124085 13362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b9338b61e514407f8c9ef8e329b68415: Sending DeleteTablet for 3 replicas of tablet ac8fb56fe6ba41bab87af112b227e6ed
I20260809 07:58:28.124851 13794 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:28 UTC) from {username='slave'} at 127.0.0.1:44820
I20260809 07:58:28.124902 13648 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:28 UTC) from {username='slave'} at 127.0.0.1:38954
I20260809 07:58:28.125077 13498 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8fb56fe6ba41bab87af112b227e6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:28 UTC) from {username='slave'} at 127.0.0.1:60124
I20260809 07:58:28.125367 13910 tablet_replica.cc:330] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: stopping tablet replica
I20260809 07:58:28.125502 13912 tablet_replica.cc:330] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f: stopping tablet replica
I20260809 07:58:28.125802 13911 tablet_replica.cc:330] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: stopping tablet replica
I20260809 07:58:28.125828 13912 raft_consensus.cc:2229] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:28.126124 13912 raft_consensus.cc:2258] T ac8fb56fe6ba41bab87af112b227e6ed P c13f4390093e4118aef5a4724eb3790f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:28.126188 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13427
I20260809 07:58:28.127221 13910 raft_consensus.cc:2229] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:28.127684 13910 raft_consensus.cc:2258] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:28.129271 13910 ts_tablet_manager.cc:1905] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:28.131421 13911 raft_consensus.cc:2229] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:28.131794 13911 raft_consensus.cc:2258] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:28.132911 13910 ts_tablet_manager.cc:1918] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:28.133020 13910 log.cc:1196] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/ac8fb56fe6ba41bab87af112b227e6ed
I20260809 07:58:28.133379 13910 ts_tablet_manager.cc:1939] T ac8fb56fe6ba41bab87af112b227e6ed P 35eceb4d80434916af981b64e47b4643: Deleting consensus metadata
I20260809 07:58:28.133383 13911 ts_tablet_manager.cc:1905] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:28.134711 13345 catalog_manager.cc:4841] TS 35eceb4d80434916af981b64e47b4643 (127.8.51.67:33617): tablet ac8fb56fe6ba41bab87af112b227e6ed (table test-table [id=e6470ddf3f6f4080aa430fbeb96dfc73]) successfully deleted
I20260809 07:58:28.136236 13911 ts_tablet_manager.cc:1918] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:28.136333 13911 log.cc:1196] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/ac8fb56fe6ba41bab87af112b227e6ed
I20260809 07:58:28.136665 13911 ts_tablet_manager.cc:1939] T ac8fb56fe6ba41bab87af112b227e6ed P 21c24bd3993e48d2a531cd6711349c6a: Deleting consensus metadata
W20260809 07:58:28.137207 13344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:45211 (error 108)
I20260809 07:58:28.137825 13346 catalog_manager.cc:4841] TS 21c24bd3993e48d2a531cd6711349c6a (127.8.51.66:42127): tablet ac8fb56fe6ba41bab87af112b227e6ed (table test-table [id=e6470ddf3f6f4080aa430fbeb96dfc73]) successfully deleted
I20260809 07:58:28.138533 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.138124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:45211 (local address 127.0.0.1:60134)
0809 07:58:28.138344 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:28.138425 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:45211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":73,"threads_started":1}
I20260809 07:58:28.138626 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13574
W20260809 07:58:28.138971 13344 catalog_manager.cc:4584] TS c13f4390093e4118aef5a4724eb3790f (127.8.51.65:45211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac8fb56fe6ba41bab87af112b227e6ed: Network error: Client connection negotiation failed: client connection to 127.8.51.65:45211: connect: Connection refused (error 111)
I20260809 07:58:28.146934 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13722
I20260809 07:58:28.153066 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13328
2026-08-09T07:58:28Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1409 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 07:58:28.174561 8397 mini_oidc.cc:152] Starting JWKS server
I20260809 07:58:28.176275 8397 webserver.cc:460] Webserver started at https://127.0.0.1:40117/ using document root <none> and password file <none>
I20260809 07:58:28.176482 8397 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 07:58:28.176764 8397 webserver.cc:460] Webserver started at http://127.0.0.1:43935/ using document root <none> and password file <none>
2026-08-09T07:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:28Z Disabled control of system clock
I20260809 07:58:28.186756 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42039
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:37865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42039
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40117/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/testchainca.cert with env {}
W20260809 07:58:28.294592 13921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:28.294845 13921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:28.294924 13921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:28.298781 13921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:28.298834 13921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:28.298851 13921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:28.298867 13921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:28.298940 13921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 07:58:28.298960 13921 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 07:58:28.298992 13921 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40117/jwks.json
I20260809 07:58:28.304175 13921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:37865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42039
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40117/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:28.305166 13921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:28.306136 13921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:28.314443 13926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.314495 13929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.314469 13927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:28.314851 13921 server_base.cc:1034] running on GCE node
I20260809 07:58:28.315392 13921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:28.316406 13921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:28.317561 13921 hybrid_clock.cc:648] HybridClock initialized: now 1786262308317548 us; error 25 us; skew 500 ppm
I20260809 07:58:28.319350 13921 webserver.cc:460] Webserver started at http://127.8.51.126:40163/ using document root <none> and password file <none>
I20260809 07:58:28.319911 13921 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:28.319972 13921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:28.320181 13921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:28.322171 13921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "be49b96500f8422fa009beec77b3feb4"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "210bf6a12913cda0a0481c328327de49"
server_key_iv: "ad8f7890eb1c8cfa5272ce52046507fa"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.322751 13921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "be49b96500f8422fa009beec77b3feb4"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "210bf6a12913cda0a0481c328327de49"
server_key_iv: "ad8f7890eb1c8cfa5272ce52046507fa"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.326359 13921 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 07:58:28.328625 13936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:28.329823 13921 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 07:58:28.329953 13921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "be49b96500f8422fa009beec77b3feb4"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "210bf6a12913cda0a0481c328327de49"
server_key_iv: "ad8f7890eb1c8cfa5272ce52046507fa"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.330054 13921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:28.361464 13921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:28.362284 13921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:28.362494 13921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:28.369454 13921 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:42039
I20260809 07:58:28.369467 13994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:42039 every 8 connection(s)
I20260809 07:58:28.370474 13921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:28.372300 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 13921
I20260809 07:58:28.372458 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:28.372749 8397 external_mini_cluster.cc:1428] Setting key 0b21dc8b0339e78a8a623618a90df463
I20260809 07:58:28.373682 13995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:28.380923 13995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4: Bootstrap starting.
I20260809 07:58:28.383490 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.374185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.8.51.126:42039)
0809 07:58:28.374897 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:28.374919 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:28.374964 (+ 45us) server_negotiation.cc:407] Connection header received
0809 07:58:28.375834 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:28.375858 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:28.376375 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:28.376822 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:28.377278 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.378743 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.379621 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.380320 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.380494 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.381372 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:28.381379 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:28.381412 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:28.381945 (+ 533us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:28.382016 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:28.382044 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:28.382146 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:28.382259 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 07:58:28.382575 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":127,"threads_started":1}
I20260809 07:58:28.383803 13995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:28.384703 13995 log.cc:824] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:28.386500 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 07:58:28.386965 13995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4: No bootstrap required, opened a new log
I20260809 07:58:28.390880 13995 raft_consensus.cc:348] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } }
I20260809 07:58:28.391135 13995 raft_consensus.cc:374] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:28.391216 13995 raft_consensus.cc:729] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be49b96500f8422fa009beec77b3feb4, State: Initialized, Role: FOLLOWER
I20260809 07:58:28.391688 13995 consensus_queue.cc:260] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } }
I20260809 07:58:28.391835 13995 raft_consensus.cc:388] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:28.391924 13995 raft_consensus.cc:482] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:28.392025 13995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:28.392946 13995 raft_consensus.cc:504] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } }
I20260809 07:58:28.393298 13995 leader_election.cc:302] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be49b96500f8422fa009beec77b3feb4; no voters:
I20260809 07:58:28.393669 13995 leader_election.cc:288] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:28.393769 14000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:28.394050 14000 raft_consensus.cc:686] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [term 1 LEADER]: Becoming Leader. State: Replica: be49b96500f8422fa009beec77b3feb4, State: Running, Role: LEADER
I20260809 07:58:28.394404 14000 consensus_queue.cc:237] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } }
I20260809 07:58:28.394979 13995 sys_catalog.cc:564] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:28.396090 14002 sys_catalog.cc:455] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be49b96500f8422fa009beec77b3feb4. Latest consensus state: current_term: 1 leader_uuid: "be49b96500f8422fa009beec77b3feb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } } }
I20260809 07:58:28.396257 14002 sys_catalog.cc:458] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:28.396620 14001 sys_catalog.cc:455] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be49b96500f8422fa009beec77b3feb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be49b96500f8422fa009beec77b3feb4" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42039 } } }
I20260809 07:58:28.397284 14009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:28.397285 14001 sys_catalog.cc:458] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:28.399923 14009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:28.405470 14009 catalog_manager.cc:1347] Generated new cluster ID: 3a19ed4dc59b470bb3f2debc60d3be00
I20260809 07:58:28.405536 14009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:28.417151 14009 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:28.418355 14009 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:28.424649 14009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be49b96500f8422fa009beec77b3feb4: Generated new TSK 0
I20260809 07:58:28.425405 14009 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 07:58:28.460580 14025 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 07:58:28.460742 14025 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 07:58:28.461285 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.444138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.8.51.126:42039)
0809 07:58:28.444296 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:28.444303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:28.444517 (+ 214us) server_negotiation.cc:407] Connection header received
0809 07:58:28.444742 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:28.444745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:28.444792 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:28.444879 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0809 07:58:28.445183 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.445787 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.447032 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.447243 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.447318 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.447694 (+ 376us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 07:58:28.460895 (+ 13201us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 07:58:28.461145 (+ 250us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53120: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 07:58:28.461392 13998 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53120: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 07:58:28.462984 14024 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:28.444032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42039 (local address 127.0.0.1:53120)
0809 07:58:28.444424 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:28.444440 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:28.444587 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:28.444921 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:28.444924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:28.444933 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 07:58:28.445069 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:28.445076 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.445894 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.445898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:28.446920 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:28.446931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.447355 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.447359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:28.447455 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.447510 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 07:58:28.461159 (+ 13649us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 07:58:28.461461 (+ 302us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.51.126:42039: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":129,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.8.51.126:42039: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40117/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 07:58:28.463770 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 13921
2026-08-09T07:58:28Z chronyd exiting
I20260809 07:58:28.502655 8397 test_util.cc:175] -----------------------------------------------
I20260809 07:58:28.502760 8397 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786262281998942-8397-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (329 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 07:58:28.503836 8397 mini_oidc.cc:152] Starting JWKS server
I20260809 07:58:28.504711 8397 webserver.cc:460] Webserver started at https://127.0.0.1:35187/ using document root <none> and password file <none>
I20260809 07:58:28.504839 8397 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 07:58:28.505105 8397 webserver.cc:460] Webserver started at http://127.0.0.1:36993/ using document root <none> and password file <none>
2026-08-09T07:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:28Z Disabled control of system clock
I20260809 07:58:28.515134 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40153
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:45011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:40153
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35187/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/testchainca.cert with env {}
W20260809 07:58:28.624440 14031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:28.624722 14031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:28.624760 14031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:28.628822 14031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:28.628891 14031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:28.628907 14031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:28.628924 14031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:28.628973 14031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 07:58:28.629007 14031 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 07:58:28.629032 14031 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35187/jwks.json
I20260809 07:58:28.634475 14031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:40153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35187/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:28.635602 14031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:28.636643 14031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:28.645180 14037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.645237 14036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.645237 14040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:28.645558 14031 server_base.cc:1034] running on GCE node
I20260809 07:58:28.646160 14031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:28.647333 14031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:28.648527 14031 hybrid_clock.cc:648] HybridClock initialized: now 1786262308648514 us; error 26 us; skew 500 ppm
I20260809 07:58:28.650449 14031 webserver.cc:460] Webserver started at http://127.8.51.126:43473/ using document root <none> and password file <none>
I20260809 07:58:28.651042 14031 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:28.651135 14031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:28.651369 14031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:28.653419 14031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "4b44b08bad06433081d35e918ee4aa6f"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "9e79532c537c7c9a42b74c4d43c2c044"
server_key_iv: "4a705e0106462ad2fa78bc6650ff44f1"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.654074 14031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "4b44b08bad06433081d35e918ee4aa6f"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "9e79532c537c7c9a42b74c4d43c2c044"
server_key_iv: "4a705e0106462ad2fa78bc6650ff44f1"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.658577 14031 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 07:58:28.660985 14046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:28.662323 14031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:28.662465 14031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "4b44b08bad06433081d35e918ee4aa6f"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "9e79532c537c7c9a42b74c4d43c2c044"
server_key_iv: "4a705e0106462ad2fa78bc6650ff44f1"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.662590 14031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:28.685552 14031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:28.686342 14031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:28.686547 14031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:28.693132 14031 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:40153
I20260809 07:58:28.693142 14102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:40153 every 8 connection(s)
I20260809 07:58:28.694129 14031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:28.697211 14103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:28.701164 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14031
I20260809 07:58:28.701313 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:28.701661 8397 external_mini_cluster.cc:1428] Setting key b4537906795656b0689d666769e8ea6e
I20260809 07:58:28.702879 14103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f: Bootstrap starting.
I20260809 07:58:28.705188 14103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:28.706007 14103 log.cc:824] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:28.707687 14103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f: No bootstrap required, opened a new log
I20260809 07:58:28.710346 14106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.702999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46482 (local address 127.8.51.126:40153)
0809 07:58:28.703611 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:28.703635 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:28.703670 (+ 35us) server_negotiation.cc:407] Connection header received
0809 07:58:28.704267 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:28.704283 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:28.704681 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:28.705024 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:28.705480 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.706503 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.707369 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.707834 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.707986 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.708803 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:28.708815 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:28.708828 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:28.709174 (+ 346us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:28.709223 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:28.709241 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:28.709343 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:28.709462 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 07:58:28.709715 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":142,"threads_started":1}
I20260809 07:58:28.710937 14103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } }
I20260809 07:58:28.711175 14103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:28.711229 14103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b44b08bad06433081d35e918ee4aa6f, State: Initialized, Role: FOLLOWER
I20260809 07:58:28.711611 14103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } }
I20260809 07:58:28.711728 14103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:28.711810 14103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:28.711920 14103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:28.712951 14103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } }
I20260809 07:58:28.713114 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 07:58:28.713327 14103 leader_election.cc:302] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b44b08bad06433081d35e918ee4aa6f; no voters:
I20260809 07:58:28.713672 14103 leader_election.cc:288] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:28.713728 14108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:28.713934 14108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [term 1 LEADER]: Becoming Leader. State: Replica: 4b44b08bad06433081d35e918ee4aa6f, State: Running, Role: LEADER
I20260809 07:58:28.714265 14108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } }
I20260809 07:58:28.714933 14103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:28.715467 14110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b44b08bad06433081d35e918ee4aa6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } } }
I20260809 07:58:28.715616 14110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:28.715885 14109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b44b08bad06433081d35e918ee4aa6f. Latest consensus state: current_term: 1 leader_uuid: "4b44b08bad06433081d35e918ee4aa6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b44b08bad06433081d35e918ee4aa6f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40153 } } }
I20260809 07:58:28.715972 14109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:28.716121 14114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:28.719139 14114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:28.724437 14114 catalog_manager.cc:1347] Generated new cluster ID: 7bbcf0a7d5f5474aaa4ef59832929b53
I20260809 07:58:28.724502 14114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:28.739567 14114 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:28.740458 14114 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:28.745816 14114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b44b08bad06433081d35e918ee4aa6f: Generated new TSK 0
I20260809 07:58:28.746615 14114 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 07:58:28.774698 14135 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 07:58:28.774808 14135 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 07:58:28.775450 14106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:28.759222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.8.51.126:40153)
0809 07:58:28.759356 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:28.759361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:28.759567 (+ 206us) server_negotiation.cc:407] Connection header received
0809 07:58:28.759729 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:28.759731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:28.759777 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:28.759866 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0809 07:58:28.760132 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.760674 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.761945 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.762162 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.762242 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.762553 (+ 311us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 07:58:28.775110 (+ 12557us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 07:58:28.775329 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46494: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 07:58:28.775539 14106 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46494: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 07:58:28.775694 14134 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:28.759115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40153 (local address 127.0.0.1:46494)
0809 07:58:28.759470 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:28.759486 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:28.759608 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:28.759898 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:28.759901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:28.759909 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 07:58:28.760027 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:28.760033 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.760785 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.760789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:28.761834 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:28.761845 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:28.762272 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:28.762276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:28.762361 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:28.762389 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 07:58:28.775307 (+ 12918us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 07:58:28.775512 (+ 205us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.51.126:40153: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":102,"threads_started":1}
I20260809 07:58:28.776404 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14031
2026-08-09T07:58:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (313 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 07:58:28.817023 8397 mini_oidc.cc:152] Starting JWKS server
I20260809 07:58:28.818027 8397 webserver.cc:460] Webserver started at https://127.0.0.1:42163/ using document root <none> and password file <none>
I20260809 07:58:28.818146 8397 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 07:58:28.818424 8397 webserver.cc:460] Webserver started at http://127.0.0.1:42659/ using document root <none> and password file <none>
2026-08-09T07:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:28Z Disabled control of system clock
I20260809 07:58:28.828536 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36269
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:45779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36269
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42163/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 07:58:28.939143 14141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:28.939397 14141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:28.939435 14141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:28.943197 14141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:28.943240 14141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:28.943255 14141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:28.943272 14141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:28.943287 14141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 07:58:28.943302 14141 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 07:58:28.943315 14141 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42163/jwks.json
I20260809 07:58:28.947495 14141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36269
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42163/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:28.948446 14141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:28.949743 14141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:28.958037 14150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.958093 14147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:28.958050 14148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:28.958216 14141 server_base.cc:1034] running on GCE node
I20260809 07:58:28.958819 14141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:28.959833 14141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:28.960990 14141 hybrid_clock.cc:648] HybridClock initialized: now 1786262308960962 us; error 42 us; skew 500 ppm
I20260809 07:58:28.962913 14141 webserver.cc:460] Webserver started at http://127.8.51.126:45933/ using document root <none> and password file <none>
I20260809 07:58:28.963477 14141 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:28.963541 14141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:28.963797 14141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:28.966334 14141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b304139e0ff841f2834f0ade03898549"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "0ef755e0bd85a1b7792721f346531b46"
server_key_iv: "6cd5a39cbec9104c8bcdce24e0d79878"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.967013 14141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b304139e0ff841f2834f0ade03898549"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "0ef755e0bd85a1b7792721f346531b46"
server_key_iv: "6cd5a39cbec9104c8bcdce24e0d79878"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.970917 14141 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 07:58:28.973218 14158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:28.974475 14141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 07:58:28.974633 14141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b304139e0ff841f2834f0ade03898549"
format_stamp: "Formatted at 2026-08-09 07:58:28 on dist-test-slave-njxd"
server_key: "0ef755e0bd85a1b7792721f346531b46"
server_key_iv: "6cd5a39cbec9104c8bcdce24e0d79878"
server_key_version: "encryptionkey@0"
I20260809 07:58:28.974747 14141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:28.989482 14141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:28.990135 14141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:28.990324 14141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:28.997514 14141 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:36269
I20260809 07:58:28.997538 14213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:36269 every 8 connection(s)
I20260809 07:58:28.998534 14141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:29.001884 14214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:29.004740 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14141
I20260809 07:58:29.004866 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:29.005182 8397 external_mini_cluster.cc:1428] Setting key 24dd7fca97af8b9d530d0bd96c79316c
I20260809 07:58:29.008143 14214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549: Bootstrap starting.
I20260809 07:58:29.010354 14214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:29.011086 14214 log.cc:824] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:29.013041 14214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549: No bootstrap required, opened a new log
I20260809 07:58:29.014473 14217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:29.006650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58632 (local address 127.8.51.126:36269)
0809 07:58:29.007297 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:29.007312 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:29.007347 (+ 35us) server_negotiation.cc:407] Connection header received
0809 07:58:29.007956 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:29.007972 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:29.008426 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:29.008794 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:29.009226 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.010242 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.011190 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.011664 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.011834 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.012713 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:29.012717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:29.012734 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:29.013113 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:29.013212 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:29.013234 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:29.013342 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:29.013495 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 07:58:29.013776 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":116,"threads_started":1}
I20260809 07:58:29.017110 14214 raft_consensus.cc:348] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } }
I20260809 07:58:29.017391 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 07:58:29.017414 14214 raft_consensus.cc:374] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:29.017494 14214 raft_consensus.cc:729] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b304139e0ff841f2834f0ade03898549, State: Initialized, Role: FOLLOWER
I20260809 07:58:29.017983 14214 consensus_queue.cc:260] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } }
I20260809 07:58:29.018134 14214 raft_consensus.cc:388] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:29.018200 14214 raft_consensus.cc:482] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:29.018348 14214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:29.019502 14214 raft_consensus.cc:504] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } }
I20260809 07:58:29.019807 14214 leader_election.cc:302] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b304139e0ff841f2834f0ade03898549; no voters:
I20260809 07:58:29.020056 14214 leader_election.cc:288] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:29.020231 14219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:29.020490 14219 raft_consensus.cc:686] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [term 1 LEADER]: Becoming Leader. State: Replica: b304139e0ff841f2834f0ade03898549, State: Running, Role: LEADER
I20260809 07:58:29.020826 14219 consensus_queue.cc:237] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } }
I20260809 07:58:29.021347 14214 sys_catalog.cc:564] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:29.022668 14220 sys_catalog.cc:455] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b304139e0ff841f2834f0ade03898549" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } } }
I20260809 07:58:29.022704 14221 sys_catalog.cc:455] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b304139e0ff841f2834f0ade03898549. Latest consensus state: current_term: 1 leader_uuid: "b304139e0ff841f2834f0ade03898549" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b304139e0ff841f2834f0ade03898549" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36269 } } }
I20260809 07:58:29.022792 14220 sys_catalog.cc:458] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:29.022802 14221 sys_catalog.cc:458] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:29.023150 14229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:29.026480 14229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:29.031721 14229 catalog_manager.cc:1347] Generated new cluster ID: 8febb6230fd4431cb95eba6ab16d12cf
I20260809 07:58:29.031800 14229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:29.044287 14229 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:29.045284 14229 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:29.059939 14229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b304139e0ff841f2834f0ade03898549: Generated new TSK 0
I20260809 07:58:29.060676 14229 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:58:29.076845 14217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:29.071067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58644 (local address 127.8.51.126:36269)
0809 07:58:29.071246 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:29.071252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:29.071397 (+ 145us) server_negotiation.cc:407] Connection header received
0809 07:58:29.071659 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:29.071663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:29.071729 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:29.071839 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0809 07:58:29.072199 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.073014 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.074274 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.074644 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.074716 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.075136 (+ 420us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 07:58:29.076513 (+ 1377us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42163/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 07:58:29.076710 (+ 197us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58644: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42163/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 07:58:29.076907 14217 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58644: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42163/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 07:58:29.077629 14245 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:29.070866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36269 (local address 127.0.0.1:58644)
0809 07:58:29.071303 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:29.071329 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:29.071474 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:29.071947 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:29.071951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:29.071960 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 07:58:29.072071 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:29.072078 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.073171 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.073175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:29.074140 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:29.074150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.074844 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.074847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:29.074926 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.074951 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 07:58:29.077304 (+ 2353us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42163/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 07:58:29.077438 (+ 134us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.51.126:36269: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42163/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":103,"threads_started":1}
I20260809 07:58:29.078131 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14141
E20260809 07:58:29.094060 14246 webserver.cc:533] Webserver: sslize failed:
E20260809 07:58:29.094120 14246 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T07:58:29Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (308 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T07:58:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:29Z Disabled control of system clock
I20260809 07:58:29.134977 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41905
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:41905
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/testchainca.cert with env {}
W20260809 07:58:29.243211 14251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:29.243463 14251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:29.243502 14251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:29.247316 14251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:29.247365 14251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:29.247380 14251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:29.247395 14251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:29.247409 14251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 07:58:29.247424 14251 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 07:58:29.247437 14251 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 07:58:29.252574 14251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:41905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:29.253523 14251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:29.254557 14251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:29.262805 14256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:29.262816 14258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:29.262924 14251 server_base.cc:1034] running on GCE node
W20260809 07:58:29.262820 14260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:29.263609 14251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:29.264667 14251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:29.265852 14251 hybrid_clock.cc:648] HybridClock initialized: now 1786262309265836 us; error 50 us; skew 500 ppm
I20260809 07:58:29.267624 14251 webserver.cc:460] Webserver started at http://127.8.51.126:39859/ using document root <none> and password file <none>
I20260809 07:58:29.268193 14251 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:29.268292 14251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:29.268513 14251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:29.270569 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735"
format_stamp: "Formatted at 2026-08-09 07:58:29 on dist-test-slave-njxd"
server_key: "d0b19d1a77e54ed2be669ea74f4e8ea2"
server_key_iv: "bad05850b0104587b8a0a271c4c76702"
server_key_version: "encryptionkey@0"
I20260809 07:58:29.271186 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735"
format_stamp: "Formatted at 2026-08-09 07:58:29 on dist-test-slave-njxd"
server_key: "d0b19d1a77e54ed2be669ea74f4e8ea2"
server_key_iv: "bad05850b0104587b8a0a271c4c76702"
server_key_version: "encryptionkey@0"
I20260809 07:58:29.274780 14251 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:58:29.276995 14266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:29.278159 14251 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:29.278281 14251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735"
format_stamp: "Formatted at 2026-08-09 07:58:29 on dist-test-slave-njxd"
server_key: "d0b19d1a77e54ed2be669ea74f4e8ea2"
server_key_iv: "bad05850b0104587b8a0a271c4c76702"
server_key_version: "encryptionkey@0"
I20260809 07:58:29.278381 14251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:29.300961 14251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:29.301627 14251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:29.301831 14251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:29.308475 14251 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:41905
I20260809 07:58:29.308503 14322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:41905 every 8 connection(s)
I20260809 07:58:29.309358 14251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:29.310551 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14251
I20260809 07:58:29.310685 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:29.310954 8397 external_mini_cluster.cc:1428] Setting key fa9bb7305dcf64f8944cb48d6564a488
I20260809 07:58:29.312916 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:29.319478 14323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735: Bootstrap starting.
I20260809 07:58:29.319985 14327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:29.312185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.8.51.126:41905)
0809 07:58:29.312796 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:29.312811 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:29.312845 (+ 34us) server_negotiation.cc:407] Connection header received
0809 07:58:29.313498 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:29.313516 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:29.313967 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:29.314245 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:29.314639 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.315591 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.316818 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.317260 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.317368 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.318292 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:29.318297 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:29.318309 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:58:29.318680 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:29.318733 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:58:29.318751 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:29.318825 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:29.318986 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 07:58:29.319304 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":138,"threads_started":1}
I20260809 07:58:29.322057 14323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:29.322896 14323 log.cc:824] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:29.323076 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 07:58:29.325037 14323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735: No bootstrap required, opened a new log
I20260809 07:58:29.328555 14323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } }
I20260809 07:58:29.328866 14323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:29.328951 14323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7c2e596f8b4d51ad3e7d21e52ef735, State: Initialized, Role: FOLLOWER
I20260809 07:58:29.329360 14323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } }
I20260809 07:58:29.329511 14323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:29.329628 14323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:29.329751 14323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:29.330655 14323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } }
I20260809 07:58:29.331001 14323 leader_election.cc:302] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b7c2e596f8b4d51ad3e7d21e52ef735; no voters:
I20260809 07:58:29.331338 14323 leader_election.cc:288] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:29.331390 14329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:29.331703 14329 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [term 1 LEADER]: Becoming Leader. State: Replica: 6b7c2e596f8b4d51ad3e7d21e52ef735, State: Running, Role: LEADER
I20260809 07:58:29.332012 14329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } }
I20260809 07:58:29.332603 14323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:29.333782 14331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b7c2e596f8b4d51ad3e7d21e52ef735. Latest consensus state: current_term: 1 leader_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } } }
I20260809 07:58:29.333788 14330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b7c2e596f8b4d51ad3e7d21e52ef735" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41905 } } }
I20260809 07:58:29.333940 14330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:29.334348 14338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:29.334739 14331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:29.337010 14338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:29.342758 14338 catalog_manager.cc:1347] Generated new cluster ID: 65ca534aa44d44229f1e50c9ea16e9ca
I20260809 07:58:29.342823 14338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:29.348346 14338 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:29.349145 14338 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:29.358289 14338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b7c2e596f8b4d51ad3e7d21e52ef735: Generated new TSK 0
I20260809 07:58:29.358989 14338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:58:29.797394 14327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:29.373484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47224 (local address 127.8.51.126:41905)
0809 07:58:29.373654 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:29.373660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:29.373829 (+ 169us) server_negotiation.cc:407] Connection header received
0809 07:58:29.374006 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:29.374008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:29.374052 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:29.374146 (+ 94us) server_negotiation.cc:226] Negotiated authn=JWT
0809 07:58:29.374395 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.374933 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.376168 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.376387 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.376464 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.376811 (+ 347us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 07:58:29.796969 (+420158us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 07:58:29.797266 (+ 297us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47224: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 07:58:29.797473 14327 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47224: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 07:58:29.797693 14356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:29.373396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:41905 (local address 127.0.0.1:47224)
0809 07:58:29.373732 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:29.373748 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:29.373872 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:29.374169 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:29.374172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:29.374180 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 07:58:29.374293 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:29.374299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.375046 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.375050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:29.376054 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:29.376065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:29.376507 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:29.376511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:29.376617 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:29.376647 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 07:58:29.797227 (+420580us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 07:58:29.797427 (+ 200us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.51.126:41905: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":117,"threads_started":1}
I20260809 07:58:29.798384 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14251
2026-08-09T07:58:29Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (694 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (121 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (121 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:30 dist-test-slave-njxd krb5kdc[14369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:30 dist-test-slave-njxd krb5kdc[14369](info): set up 2 sockets
Aug 09 07:58:30 dist-test-slave-njxd krb5kdc[14369](info): commencing operation
krb5kdc: starting...
W20260809 07:58:31.106494 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:31.227993 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:34061
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:34061
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:31.339519 14382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:31.339771 14382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:31.339809 14382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:31.343739 14382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:31.343793 14382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:31.343812 14382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:31.343829 14382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:31.343844 14382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:31.348942 14382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:34061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:34061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:31.349999 14382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:31.350971 14382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:31.359313 14390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:31.359355 14389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:31.359428 14382 server_base.cc:1034] running on GCE node
W20260809 07:58:31.359376 14392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:31.360123 14382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:31.361268 14382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:31.362429 14382 hybrid_clock.cc:648] HybridClock initialized: now 1786262311362414 us; error 28 us; skew 500 ppm
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:31.367833 14382 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:31.368707 14382 webserver.cc:460] Webserver started at http://127.8.51.126:38487/ using document root <none> and password file <none>
I20260809 07:58:31.369283 14382 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:31.369349 14382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:31.369632 14382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:31.371819 14382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "86f8253eeb044a2c97dda951229eab1e"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "0f6287b08fcb72a22e92f1bf6344d8d1"
server_key_iv: "b4416097fd88b23493d3bdf4bad362fe"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.372385 14382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "86f8253eeb044a2c97dda951229eab1e"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "0f6287b08fcb72a22e92f1bf6344d8d1"
server_key_iv: "b4416097fd88b23493d3bdf4bad362fe"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.376133 14382 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:58:31.378544 14399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.380115 14382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:31.380260 14382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "86f8253eeb044a2c97dda951229eab1e"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "0f6287b08fcb72a22e92f1bf6344d8d1"
server_key_iv: "b4416097fd88b23493d3bdf4bad362fe"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.380390 14382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:31.393533 14382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:31.396200 14382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:31.396350 14382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:31.402679 14382 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:34061
I20260809 07:58:31.402736 14456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:34061 every 8 connection(s)
I20260809 07:58:31.403626 14382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:31.404152 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14382
I20260809 07:58:31.404290 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:31.404578 8397 external_mini_cluster.cc:1428] Setting key 2548ad9aa5e1588804b8db95496ef2fb
I20260809 07:58:31.406786 14457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:31.413359 14457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e: Bootstrap starting.
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:31.416219 14457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:31.417080 14457 log.cc:824] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:31.419373 14457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e: No bootstrap required, opened a new log
I20260809 07:58:31.419595 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:31.405907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36084 (local address 127.8.51.126:34061)
0809 07:58:31.406314 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:31.406331 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:31.406369 (+ 38us) server_negotiation.cc:407] Connection header received
0809 07:58:31.407216 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:31.407239 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:31.407620 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:31.407965 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:31.408670 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.410159 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.411001 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.411681 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.411837 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:31.414329 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:31.414335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:31.414350 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:31.414382 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:31.416470 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.416900 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.416906 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.416911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.417049 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.417377 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.417381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.417386 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.417885 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:31.418117 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:31.418388 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 07:58:31.418675 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":135,"threads_started":1}
I20260809 07:58:31.423182 14457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } }
I20260809 07:58:31.423388 14457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:31.423424 14457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f8253eeb044a2c97dda951229eab1e, State: Initialized, Role: FOLLOWER
I20260809 07:58:31.423830 14457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } }
I20260809 07:58:31.423955 14457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:31.424001 14457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:31.424067 14457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:31.424880 14457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } }
I20260809 07:58:31.425163 14457 leader_election.cc:302] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86f8253eeb044a2c97dda951229eab1e; no voters:
I20260809 07:58:31.425405 14457 leader_election.cc:288] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:31.425608 14463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:31.425895 14463 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [term 1 LEADER]: Becoming Leader. State: Replica: 86f8253eeb044a2c97dda951229eab1e, State: Running, Role: LEADER
I20260809 07:58:31.426530 14463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } }
I20260809 07:58:31.426805 14457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:31.428226 14465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86f8253eeb044a2c97dda951229eab1e. Latest consensus state: current_term: 1 leader_uuid: "86f8253eeb044a2c97dda951229eab1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } } }
I20260809 07:58:31.428247 14464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86f8253eeb044a2c97dda951229eab1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f8253eeb044a2c97dda951229eab1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 34061 } } }
I20260809 07:58:31.428376 14465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:31.428388 14464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:31.428745 14475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:31.432124 14475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:31.438079 14475 catalog_manager.cc:1347] Generated new cluster ID: 746be3d9b65b4959b0d2169771f88c18
I20260809 07:58:31.438160 14475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:31.446542 14475 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:31.447376 14475 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:31.463366 14475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86f8253eeb044a2c97dda951229eab1e: Generated new TSK 0
I20260809 07:58:31.464068 14475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:31.500519 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:31.612717 14484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:31.613003 14484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:31.613046 14484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:31.617164 14484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:31.617221 14484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:31.617280 14484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:31.622553 14484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:31.623605 14484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:31.624642 14484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:31.634130 14490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:31.634188 14489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:31.634209 14484 server_base.cc:1034] running on GCE node
W20260809 07:58:31.634155 14492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:31.634784 14484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:31.635332 14484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:31.636487 14484 hybrid_clock.cc:648] HybridClock initialized: now 1786262311636452 us; error 46 us; skew 500 ppm
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:31.639328 14484 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:31.640187 14484 webserver.cc:460] Webserver started at http://127.8.51.65:41805/ using document root <none> and password file <none>
I20260809 07:58:31.640753 14484 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:31.640847 14484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:31.641085 14484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:31.643265 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "11693fe76ea648f4b6a268aa49a74bd6"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "5bc2d85970b61aa0daaaf6df602a0444"
server_key_iv: "a502256306d853c641f0cbf43e54032d"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.643851 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "11693fe76ea648f4b6a268aa49a74bd6"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "5bc2d85970b61aa0daaaf6df602a0444"
server_key_iv: "a502256306d853c641f0cbf43e54032d"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.647774 14484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:58:31.650388 14499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.651620 14484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:31.651748 14484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "11693fe76ea648f4b6a268aa49a74bd6"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "5bc2d85970b61aa0daaaf6df602a0444"
server_key_iv: "a502256306d853c641f0cbf43e54032d"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.651861 14484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:31.674908 14484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:31.677989 14484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:31.678218 14484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:31.678831 14484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:31.679688 14484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:31.679734 14484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.679800 14484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:31.679831 14484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.688800 14484 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:36075
I20260809 07:58:31.688829 14622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:36075 every 8 connection(s)
I20260809 07:58:31.689783 14484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:31.697455 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14484
I20260809 07:58:31.697615 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:31.697993 8397 external_mini_cluster.cc:1428] Setting key 71e8f2735a9c308af080dcf54a002e6e
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:31.703681 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:31.691559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:56099 (local address 127.8.51.126:34061)
0809 07:58:31.691699 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:31.691703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:31.692527 (+ 824us) server_negotiation.cc:407] Connection header received
0809 07:58:31.693920 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:31.693923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:31.693968 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:31.694044 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:31.695199 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.695726 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.696792 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.697021 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.697094 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:31.699754 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:31.699758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:31.699761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:31.699786 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:31.701462 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.702123 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.702126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.702132 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.702208 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.702611 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.702613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.702614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.702778 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:31.702851 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:31.703458 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 07:58:31.703561 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:58:31.704913 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:31.691931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:34061 (local address 127.8.51.65:56099)
0809 07:58:31.692379 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:31.692420 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:31.693721 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:31.694224 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:31.694230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:31.694607 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:31.695072 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:31.695084 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.695830 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.695832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:31.696692 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:31.696701 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.697142 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.697144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:31.697285 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:31.697986 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:31.698026 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:31.699576 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:31.701620 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:31.701628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:31.701646 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:31.702015 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:31.702299 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:31.702304 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:31.702308 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:31.702512 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:31.702879 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:31.702885 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:31.703204 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 07:58:31.703410 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 07:58:31.703777 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":120,"threads_started":1}
I20260809 07:58:31.706264 14623 heartbeater.cc:347] Connected to a master server at 127.8.51.126:34061
I20260809 07:58:31.706506 14623 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:31.706982 14623 heartbeater.cc:511] Master 127.8.51.126:34061 requested a full tablet report, sending...
I20260809 07:58:31.708453 14416 ts_manager.cc:194] Registered new tserver with Master: 11693fe76ea648f4b6a268aa49a74bd6 (127.8.51.65:36075)
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:31.709612 14416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:56099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:31.728940 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:31.836844 14628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:31.837114 14628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:31.837190 14628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:31.841014 14628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:31.841087 14628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:31.841176 14628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:31.846063 14628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:31.847106 14628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:31.848127 14628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 07:58:31.857690 14628 server_base.cc:1034] running on GCE node
W20260809 07:58:31.857704 14634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:31.857702 14633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:31.857846 14636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:31.858314 14628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:31.858901 14628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:31.860083 14628 hybrid_clock.cc:648] HybridClock initialized: now 1786262311860065 us; error 30 us; skew 500 ppm
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:31.862901 14628 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:31.863722 14628 webserver.cc:460] Webserver started at http://127.8.51.66:37743/ using document root <none> and password file <none>
I20260809 07:58:31.864279 14628 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:31.864357 14628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:31.864564 14628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:31.866567 14628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "074c63aa61994b46b7c5088e54d9449f"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "d01109d573d714d8955e1ccc56ae6b33"
server_key_iv: "1eb0d4620fbc5d312f1e26328d36b1b3"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.867125 14628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "074c63aa61994b46b7c5088e54d9449f"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "d01109d573d714d8955e1ccc56ae6b33"
server_key_iv: "1eb0d4620fbc5d312f1e26328d36b1b3"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.870612 14628 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 07:58:31.872917 14643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.874153 14628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 07:58:31.874276 14628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "074c63aa61994b46b7c5088e54d9449f"
format_stamp: "Formatted at 2026-08-09 07:58:31 on dist-test-slave-njxd"
server_key: "d01109d573d714d8955e1ccc56ae6b33"
server_key_iv: "1eb0d4620fbc5d312f1e26328d36b1b3"
server_key_version: "encryptionkey@0"
I20260809 07:58:31.874379 14628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:31.898280 14628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:31.900844 14628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:31.900983 14628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:31.901489 14628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:31.902271 14628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:31.902315 14628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.902352 14628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:31.902374 14628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:31.910336 14628 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:35719
I20260809 07:58:31.910379 14763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:35719 every 8 connection(s)
I20260809 07:58:31.911119 14628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:31.915557 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14628
I20260809 07:58:31.915699 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:31.915992 8397 external_mini_cluster.cc:1428] Setting key fa3b23ff59fd3ef2bf7436e67c844119
Aug 09 07:58:31 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262311, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:31.925480 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:31.912783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:58341 (local address 127.8.51.126:34061)
0809 07:58:31.912914 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:31.912918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:31.913772 (+ 854us) server_negotiation.cc:407] Connection header received
0809 07:58:31.915150 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:31.915153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:31.915209 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:31.915293 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:31.916592 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.917194 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.918488 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.918875 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.918995 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:31.921748 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:31.921751 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:31.921753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:31.921775 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:31.923397 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.923919 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.923923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.923925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.924007 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:31.924357 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:31.924360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:31.924361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:31.924602 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:31.924705 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:31.925175 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 07:58:31.925312 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:58:31.926367 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:31.913146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:34061 (local address 127.8.51.66:58341)
0809 07:58:31.913630 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:31.913673 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:31.914943 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:31.915454 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:31.915461 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:31.915898 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:31.916438 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:31.916457 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.917320 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.917323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:31.918364 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:31.918374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:31.919020 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:31.919026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:31.919215 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:31.919860 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:31.919885 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:31.921511 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:31.923519 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:31.923526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:31.923540 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:31.923808 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:31.924098 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:31.924101 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:31.924103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:31.924256 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:31.924702 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:31.924709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:31.924934 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 07:58:31.925107 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 07:58:31.925435 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260809 07:58:31.927601 14764 heartbeater.cc:347] Connected to a master server at 127.8.51.126:34061
I20260809 07:58:31.927867 14764 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:31.928429 14764 heartbeater.cc:511] Master 127.8.51.126:34061 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:31.929548 14416 ts_manager.cc:194] Registered new tserver with Master: 074c63aa61994b46b7c5088e54d9449f (127.8.51.66:35719)
I20260809 07:58:31.930420 14416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:58341
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:31.944304 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:32.053916 14769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:32.054180 14769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:32.054252 14769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:32.058388 14769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:32.058461 14769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:32.058544 14769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:32.063503 14769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:34061
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:32.064482 14769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:32.065433 14769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:32.074985 14775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:32.075008 14774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:32.075038 14769 server_base.cc:1034] running on GCE node
W20260809 07:58:32.074998 14777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:32.075601 14769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:32.076256 14769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:32.077436 14769 hybrid_clock.cc:648] HybridClock initialized: now 1786262312077423 us; error 25 us; skew 500 ppm
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.080247 14769 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:32.081085 14769 webserver.cc:460] Webserver started at http://127.8.51.67:42459/ using document root <none> and password file <none>
I20260809 07:58:32.081667 14769 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:32.081734 14769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:32.081907 14769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:32.083904 14769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "d1841ecf361f4602aaad56e48c49dbd0"
format_stamp: "Formatted at 2026-08-09 07:58:32 on dist-test-slave-njxd"
server_key: "2448d415c820b8845bda9faa5eb5085e"
server_key_iv: "ce2d041e7707039eeac2dba9a54a1721"
server_key_version: "encryptionkey@0"
I20260809 07:58:32.084511 14769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "d1841ecf361f4602aaad56e48c49dbd0"
format_stamp: "Formatted at 2026-08-09 07:58:32 on dist-test-slave-njxd"
server_key: "2448d415c820b8845bda9faa5eb5085e"
server_key_iv: "ce2d041e7707039eeac2dba9a54a1721"
server_key_version: "encryptionkey@0"
I20260809 07:58:32.087925 14769 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 07:58:32.090131 14784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:32.091300 14769 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:32.091388 14769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "d1841ecf361f4602aaad56e48c49dbd0"
format_stamp: "Formatted at 2026-08-09 07:58:32 on dist-test-slave-njxd"
server_key: "2448d415c820b8845bda9faa5eb5085e"
server_key_iv: "ce2d041e7707039eeac2dba9a54a1721"
server_key_version: "encryptionkey@0"
I20260809 07:58:32.091461 14769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:32.100412 14769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:32.102993 14769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:32.103181 14769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:32.103647 14769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:32.104360 14769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:32.104411 14769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:32.104447 14769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:32.104465 14769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:32.113217 14769 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:39289
I20260809 07:58:32.113245 14906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:39289 every 8 connection(s)
I20260809 07:58:32.114090 14769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:32.120438 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14769
I20260809 07:58:32.120532 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:32.120827 8397 external_mini_cluster.cc:1428] Setting key 0e62fe3fe20a92ae71f0b580749f2274
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:32.127255 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:32.115786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:50927 (local address 127.8.51.126:34061)
0809 07:58:32.115922 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.115926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.116678 (+ 752us) server_negotiation.cc:407] Connection header received
0809 07:58:32.117946 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.117949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.117993 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.118064 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.119088 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.119583 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.120673 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.120973 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.121097 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:32.123901 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:32.123904 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:32.123906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:32.123927 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:32.125423 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.125909 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.125911 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.125912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.125986 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.126289 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.126291 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.126292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.126444 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:32.126513 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:32.126997 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 07:58:32.127112 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:32.128064 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:32.116121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:34061 (local address 127.8.51.67:50927)
0809 07:58:32.116536 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:32.116575 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:32.117766 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:32.118214 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:32.118220 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:32.118541 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:32.118970 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:32.118982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.119687 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.119690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:32.120550 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:32.120563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.121152 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.121158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:32.121349 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:32.121951 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:32.121966 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:32.123760 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:32.125516 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:32.125520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:32.125529 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:32.125824 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:32.126067 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:32.126069 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:32.126070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:32.126206 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:32.126526 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:32.126530 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:32.126786 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 07:58:32.126936 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 07:58:32.127208 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20260809 07:58:32.129146 14907 heartbeater.cc:347] Connected to a master server at 127.8.51.126:34061
I20260809 07:58:32.129367 14907 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:32.129880 14907 heartbeater.cc:511] Master 127.8.51.126:34061 requested a full tablet report, sending...
I20260809 07:58:32.130822 14416 ts_manager.cc:194] Registered new tserver with Master: d1841ecf361f4602aaad56e48c49dbd0 (127.8.51.67:39289)
I20260809 07:58:32.131333 14416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:50927
I20260809 07:58:32.134721 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/test-admin.keytab.
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.150089 8397 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 07:58:32.152570 14914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:32.151283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.8.51.65:36075)
0809 07:58:32.151513 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.151552 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.151584 (+ 32us) server_negotiation.cc:407] Connection header received
0809 07:58:32.151644 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.151650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.151827 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.151954 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.152374 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42914: BlockingRecv error: recv got EOF from 127.0.0.1:42914 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":73,"threads_started":1}
W20260809 07:58:32.152665 8397 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc' of type FILE
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.153723 8397 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.154660 8397 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:32.164077 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:32.155520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.8.51.65:36075)
0809 07:58:32.155643 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.155648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.155766 (+ 118us) server_negotiation.cc:407] Connection header received
0809 07:58:32.155919 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.155921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.155956 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.156036 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.156549 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.157288 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.158185 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.158528 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.158656 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:32.160760 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:32.160768 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:32.160779 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:32.160799 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:32.162330 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.162769 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.162774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.162775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.162849 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.163148 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.163151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.163153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.163371 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:32.163563 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:32.163804 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 07:58:32.163964 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 07:58:32.167312 14914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:32.166589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42924 (local address 127.8.51.65:36075)
0809 07:58:32.166713 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.166716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.166727 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:32.166815 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.166816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.166845 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.166901 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.167226 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42924: BlockingRecv error: recv got EOF from 127.0.0.1:42924 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 07:58:32.167397 8397 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc' of type FILE
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.168263 8397 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.169030 8397 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:32.176789 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:32.169719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.8.51.65:36075)
0809 07:58:32.169859 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.169862 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.169918 (+ 56us) server_negotiation.cc:407] Connection header received
0809 07:58:32.169990 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.169991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.170019 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.170080 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.170528 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.170995 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.171793 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.171997 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.172071 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:32.174071 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:32.174074 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:32.174076 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:32.174097 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:32.175380 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.175747 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.175750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.175751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.175821 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.176045 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.176047 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.176048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.176198 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:32.176297 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:32.176488 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 07:58:32.176607 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 07:58:32.179581 14914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:32.178642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.8.51.65:36075)
0809 07:58:32.178762 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.178773 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.178789 (+ 16us) server_negotiation.cc:407] Connection header received
0809 07:58:32.178896 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.178899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.178932 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.178995 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.179480 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42938: BlockingRecv error: recv got EOF from 127.0.0.1:42938 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 07:58:32.179649 8397 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786262281998942-8397-0/krb5kdc/krb5cc' of type FILE
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.180608 8397 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:32.181427 8397 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 07:58:32.189976 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:32.182250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42946 (local address 127.8.51.65:36075)
0809 07:58:32.182366 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:32.182370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:32.182470 (+ 100us) server_negotiation.cc:407] Connection header received
0809 07:58:32.182625 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:32.182628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:32.182680 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:32.182769 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:32.183305 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.183886 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.184674 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:32.184968 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:32.185058 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:32.187264 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:32.187268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:32.187270 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:32.187298 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:32.188393 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.188794 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.188798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.188799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.188878 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:32.189147 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:32.189151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:32.189152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:32.189306 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:32.189445 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:32.189737 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 07:58:32.189842 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 07:58:32.190893 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14484
I20260809 07:58:32.198575 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14628
I20260809 07:58:32.205964 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14769
I20260809 07:58:32.211676 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14382
2026-08-09T07:58:32Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2171 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14929](info): set up 2 sockets
Aug 09 07:58:32 dist-test-slave-njxd krb5kdc[14929](info): commencing operation
krb5kdc: starting...
W20260809 07:58:33.260066 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:33Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab.
Entry for principal oryx/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab.
I20260809 07:58:33.380306 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36079
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab
--principal=oryx/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:33.492071 14944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:33.492305 14944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:33.492343 14944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:33.496354 14944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:33.496402 14944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:33.496420 14944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:33.496436 14944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:33.496450 14944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:33.501739 14944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab
--principal=oryx/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:33.502694 14944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:33.503655 14944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:33.512127 14949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.512086 14952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.512086 14950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:33.512235 14944 server_base.cc:1034] running on GCE node
I20260809 07:58:33.512974 14944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:33.514065 14944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:33.515269 14944 hybrid_clock.cc:648] HybridClock initialized: now 1786262313515251 us; error 27 us; skew 500 ppm
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:33.518010 14944 init.cc:377] Logged in from keytab as oryx/127.8.51.126@KRBTEST.COM (short username oryx)
I20260809 07:58:33.518873 14944 webserver.cc:460] Webserver started at http://127.8.51.126:33673/ using document root <none> and password file <none>
I20260809 07:58:33.519407 14944 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:33.519467 14944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:33.519711 14944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:33.521780 14944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "8119b7326f3e47fd902d890bf112b99d"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "948b02b81736b193e7de25e9e8e01b25"
server_key_iv: "fb98f3f10ab81e30f7503f6ddca1f223"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.522375 14944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "8119b7326f3e47fd902d890bf112b99d"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "948b02b81736b193e7de25e9e8e01b25"
server_key_iv: "fb98f3f10ab81e30f7503f6ddca1f223"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.526168 14944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 07:58:33.528410 14959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:33.529685 14944 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:33.529814 14944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "8119b7326f3e47fd902d890bf112b99d"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "948b02b81736b193e7de25e9e8e01b25"
server_key_iv: "fb98f3f10ab81e30f7503f6ddca1f223"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.529909 14944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:33.543772 14944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:33.547279 14944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:33.547503 14944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:33.554543 14944 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:36079
I20260809 07:58:33.554797 15016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:36079 every 8 connection(s)
I20260809 07:58:33.555526 14944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:33.555943 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 14944
I20260809 07:58:33.556080 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:33.556375 8397 external_mini_cluster.cc:1428] Setting key bea128923d1c9bb9cdf40fc3c2ca310f
I20260809 07:58:33.558676 15017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:33.565261 15017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Bootstrap starting.
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:33.567705 15017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:33.568435 15017 log.cc:824] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:33.570531 15017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: No bootstrap required, opened a new log
I20260809 07:58:33.570650 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:33.557785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.8.51.126:36079)
0809 07:58:33.558187 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:33.558204 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:33.558238 (+ 34us) server_negotiation.cc:407] Connection header received
0809 07:58:33.558905 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:33.558924 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:33.559261 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:33.559532 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:33.560463 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.561409 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.562595 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.563037 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.563152 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:33.566024 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:33.566029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:33.566041 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:33.566066 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:33.567696 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:33.568143 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:33.568147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:33.568152 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:33.568259 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:33.568566 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:33.568571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:33.568578 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:33.569056 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:33.569275 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:33.569569 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 07:58:33.569928 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":136,"threads_started":1}
I20260809 07:58:33.574170 15017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } }
I20260809 07:58:33.574395 15017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:33.574468 15017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8119b7326f3e47fd902d890bf112b99d, State: Initialized, Role: FOLLOWER
I20260809 07:58:33.574868 15017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } }
I20260809 07:58:33.575049 15017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:33.575114 15017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:33.575237 15017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:33.576081 15017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } }
I20260809 07:58:33.576435 15017 leader_election.cc:302] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8119b7326f3e47fd902d890bf112b99d; no voters:
I20260809 07:58:33.576731 15017 leader_election.cc:288] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:33.576860 15022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:33.577134 15022 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 LEADER]: Becoming Leader. State: Replica: 8119b7326f3e47fd902d890bf112b99d, State: Running, Role: LEADER
I20260809 07:58:33.577490 15022 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } }
I20260809 07:58:33.578075 15017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:33.579387 15023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } }
I20260809 07:58:33.579414 15024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8119b7326f3e47fd902d890bf112b99d. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } }
I20260809 07:58:33.579528 15023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:33.579535 15024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:33.579870 15032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:33.582875 15032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:33.588090 15032 catalog_manager.cc:1347] Generated new cluster ID: 757cf027b1594bd2b5f5d54ed01b0a95
I20260809 07:58:33.588168 15032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:33.601176 15032 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:33.602404 15032 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:33.609547 15032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Generated new TSK 0
I20260809 07:58:33.610285 15032 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
I20260809 07:58:33.642544 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:33.753773 15046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:33.754045 15046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:33.754117 15046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:33.758206 15046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:33.758258 15046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:33.758368 15046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:33.763476 15046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:33.764564 15046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:33.765630 15046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:33.774940 15051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.774948 15054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.774968 15052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:33.775496 15046 server_base.cc:1034] running on GCE node
I20260809 07:58:33.775909 15046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:33.776551 15046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:33.777738 15046 hybrid_clock.cc:648] HybridClock initialized: now 1786262313777724 us; error 37 us; skew 500 ppm
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:33.780690 15046 init.cc:377] Logged in from keytab as oryx/127.8.51.65@KRBTEST.COM (short username oryx)
I20260809 07:58:33.781556 15046 webserver.cc:460] Webserver started at http://127.8.51.65:34435/ using document root <none> and password file <none>
I20260809 07:58:33.782159 15046 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:33.782222 15046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:33.782385 15046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:33.784358 15046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "e1f4866b414f4baab81a9aefa4326b5f"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "5435f0569ded7db4d5401161a73bade6"
server_key_iv: "4b54174d17abda0051ec284bb86a5295"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.784875 15046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "e1f4866b414f4baab81a9aefa4326b5f"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "5435f0569ded7db4d5401161a73bade6"
server_key_iv: "4b54174d17abda0051ec284bb86a5295"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.788508 15046 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 07:58:33.790938 15061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:33.792099 15046 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:33.792218 15046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "e1f4866b414f4baab81a9aefa4326b5f"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "5435f0569ded7db4d5401161a73bade6"
server_key_iv: "4b54174d17abda0051ec284bb86a5295"
server_key_version: "encryptionkey@0"
I20260809 07:58:33.792320 15046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:33.802243 15046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:33.804955 15046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:33.805148 15046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:33.805747 15046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:33.806511 15046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:33.806557 15046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:33.806624 15046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:33.806654 15046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:33.815280 15046 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:35919
I20260809 07:58:33.815325 15179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:35919 every 8 connection(s)
I20260809 07:58:33.816213 15046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:33.819160 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15046
I20260809 07:58:33.819296 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:33.819623 8397 external_mini_cluster.cc:1428] Setting key 7e1fda7cb7c7579eff6a3b4b8d1187cc
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:33.831101 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:33.818021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:60859 (local address 127.8.51.126:36079)
0809 07:58:33.818154 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:33.818158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:33.819040 (+ 882us) server_negotiation.cc:407] Connection header received
0809 07:58:33.820535 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:33.820539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:33.820589 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:33.820667 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:33.821982 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.822503 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.824287 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.824531 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.824609 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:33.827538 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:33.827541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:33.827543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:33.827567 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:33.829005 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:33.829502 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:33.829506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:33.829508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:33.829649 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:33.830090 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:33.830093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:33.830094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:33.830272 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:33.830346 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:33.830851 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 07:58:33.830980 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:33.831960 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:33.818401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:60859)
0809 07:58:33.818895 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:33.818937 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:33.820325 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:33.820857 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:33.820866 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:33.821297 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:33.821844 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:33.821857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.822638 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.822642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:33.824137 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:33.824152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:33.824684 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:33.824691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:33.824958 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:33.825635 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:33.825663 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:33.827361 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:33.829126 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:33.829131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:33.829147 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:33.829397 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:33.829776 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:33.829781 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:33.829784 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:33.829979 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:33.830363 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:33.830368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:33.830592 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 07:58:33.830794 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 07:58:33.831053 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:33.833364 15180 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:33.833660 15180 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:33.834379 15180 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:33.835958 14978 ts_manager.cc:194] Registered new tserver with Master: e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65:35919)
I20260809 07:58:33.837047 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:60859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
I20260809 07:58:33.848348 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:33.972404 15185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:33.972633 15185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:33.972674 15185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:33.976790 15185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:33.976841 15185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:33.976898 15185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:33.982185 15185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:33.983163 15185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:33.984525 15185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:33.994441 15190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.994412 15192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:33.994449 15195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:33.994746 15185 server_base.cc:1034] running on GCE node
I20260809 07:58:33.995218 15185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:33.995879 15185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:33.997056 15185 hybrid_clock.cc:648] HybridClock initialized: now 1786262313997029 us; error 41 us; skew 500 ppm
Aug 09 07:58:33 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:33.999768 15185 init.cc:377] Logged in from keytab as oryx/127.8.51.66@KRBTEST.COM (short username oryx)
I20260809 07:58:34.000530 15185 webserver.cc:460] Webserver started at http://127.8.51.66:37451/ using document root <none> and password file <none>
I20260809 07:58:34.001021 15185 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.001075 15185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.001236 15185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:34.003260 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "d7b9d71a26a047279fbce739a3cca873"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "b142dd3bd4ca5b702390b383ff81c95a"
server_key_iv: "6291ae4894cf77aa0d78efa5f8f08546"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.003767 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "d7b9d71a26a047279fbce739a3cca873"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "b142dd3bd4ca5b702390b383ff81c95a"
server_key_iv: "6291ae4894cf77aa0d78efa5f8f08546"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.007366 15185 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 07:58:34.009708 15202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.010872 15185 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:34.010989 15185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "d7b9d71a26a047279fbce739a3cca873"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "b142dd3bd4ca5b702390b383ff81c95a"
server_key_iv: "6291ae4894cf77aa0d78efa5f8f08546"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.011090 15185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.022861 15185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.025484 15185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:34.025731 15185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:34.026296 15185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:34.027076 15185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:34.027122 15185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.027194 15185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:34.027235 15185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.036755 15185 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:46611
I20260809 07:58:34.036787 15319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:46611 every 8 connection(s)
I20260809 07:58:34.037730 15185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:34.045436 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15185
I20260809 07:58:34.045570 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:34.045897 8397 external_mini_cluster.cc:1428] Setting key 9b68f711fee0715a09ba99a9d5abe370
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:34.051545 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.039429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:34663 (local address 127.8.51.126:36079)
0809 07:58:34.039592 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.039597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.040414 (+ 817us) server_negotiation.cc:407] Connection header received
0809 07:58:34.041673 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.041676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.041721 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.041793 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.042964 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.043485 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.044567 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.044779 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.044853 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.047496 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.047499 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.047501 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.047526 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.049234 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.049927 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.049929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.049930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.050002 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.050399 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.050401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.050402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.050560 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.050632 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.051260 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.051382 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 07:58:34.052311 15322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.039830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:34663)
0809 07:58:34.040260 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.040301 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.041425 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.041954 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.041961 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.042342 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.042834 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.042847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.043590 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.043592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.044464 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.044472 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.044900 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.044902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.045034 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.045654 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.045670 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.047342 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.049341 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.049346 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.049357 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.049797 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.050095 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.050101 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.050103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.050303 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.050666 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.050675 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.050980 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.051211 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.051515 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":106,"threads_started":1}
I20260809 07:58:34.053460 15320 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:34.053741 15320 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:34.054221 15320 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:34.055296 14978 ts_manager.cc:194] Registered new tserver with Master: d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:34.056107 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:34663
WARNING: no policy specified for oryx/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
I20260809 07:58:34.073997 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:34.183826 15325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:34.184072 15325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:34.184114 15325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:34.188014 15325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:34.188076 15325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:34.188129 15325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:34.193081 15325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:36079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:34.194054 15325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:34.194991 15325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:34.204010 15333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.204010 15331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.204051 15330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:34.204370 15325 server_base.cc:1034] running on GCE node
I20260809 07:58:34.204828 15325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:34.205456 15325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:34.206617 15325 hybrid_clock.cc:648] HybridClock initialized: now 1786262314206587 us; error 44 us; skew 500 ppm
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:34.209504 15325 init.cc:377] Logged in from keytab as oryx/127.8.51.67@KRBTEST.COM (short username oryx)
I20260809 07:58:34.210342 15325 webserver.cc:460] Webserver started at http://127.8.51.67:36759/ using document root <none> and password file <none>
I20260809 07:58:34.210875 15325 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.210968 15325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.211197 15325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:34.213133 15325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "f592223a687d4ae5be44bd518655fc2c"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "23a3df5545aa2183d8dbdf5c36fa9724"
server_key_iv: "dcf69a89508a9545fc1fc180dc597874"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.213784 15325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "f592223a687d4ae5be44bd518655fc2c"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "23a3df5545aa2183d8dbdf5c36fa9724"
server_key_iv: "dcf69a89508a9545fc1fc180dc597874"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.217478 15325 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 07:58:34.219901 15342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.221135 15325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:34.221274 15325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "f592223a687d4ae5be44bd518655fc2c"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "23a3df5545aa2183d8dbdf5c36fa9724"
server_key_iv: "dcf69a89508a9545fc1fc180dc597874"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.221381 15325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.247900 15325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.250972 15325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:34.251194 15325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:34.251816 15325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:34.252655 15325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:34.252732 15325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.252822 15325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:34.252873 15325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.261564 15325 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:40323
I20260809 07:58:34.261648 15465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:40323 every 8 connection(s)
I20260809 07:58:34.262554 15325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:34.270622 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15325
I20260809 07:58:34.270785 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:34.271147 8397 external_mini_cluster.cc:1428] Setting key 0989f57f6f800ba9f2f1f5761cd0bd0e
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:34.276670 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.264493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:42345 (local address 127.8.51.126:36079)
0809 07:58:34.264636 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.264639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.265415 (+ 776us) server_negotiation.cc:407] Connection header received
0809 07:58:34.266731 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.266734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.266793 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.266909 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.268077 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.268601 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.269838 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.270069 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.270189 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.273096 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.273100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.273103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.273138 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.274545 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.275092 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.275096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.275097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.275184 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.275531 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.275536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.275538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.275741 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.275851 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.276371 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.276499 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 07:58:34.277521 15469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.264820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:42345)
0809 07:58:34.265256 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.265298 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.266512 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.267077 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.267083 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.267457 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.267924 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.267937 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.268734 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.268737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.269714 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.269724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.270234 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.270237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.270420 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.271091 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.271114 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.272928 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.274687 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.274693 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.274710 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.274982 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.275276 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.275280 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.275282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.275433 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.275849 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.275857 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.276120 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.276329 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.276673 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":112,"threads_started":1}
I20260809 07:58:34.278699 15466 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:34.278925 15466 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:34.279497 15466 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:34.280489 14978 ts_manager.cc:194] Registered new tserver with Master: f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:34.281021 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:42345
I20260809 07:58:34.285169 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.51.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.125.keytab.
Entry for principal oryx/127.8.51.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.125.keytab.
I20260809 07:58:34.312597 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:37403
--webserver_interface=127.8.51.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.125.keytab
--principal=oryx/127.8.51.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36079,127.8.51.125:37403
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:34.422746 15473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:34.423023 15473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:34.423063 15473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:34.427034 15473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:34.427090 15473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:34.427109 15473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:34.427125 15473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:34.427140 15473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:34.432250 15473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36079,127.8.51.125:37403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.125.keytab
--principal=oryx/127.8.51.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:37403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.51.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
W20260809 07:58:34.432442 15473 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.8.51.126:36079,127.8.51.125:37403'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 07:58:34.433305 15473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:34.434369 15473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:34.442895 15483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.442848 15480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.442848 15478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:34.443174 15473 server_base.cc:1034] running on GCE node
I20260809 07:58:34.443732 15473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:34.444886 15473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:34.446046 15473 hybrid_clock.cc:648] HybridClock initialized: now 1786262314446028 us; error 33 us; skew 500 ppm
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:34.448829 15473 init.cc:377] Logged in from keytab as oryx/127.8.51.125@KRBTEST.COM (short username oryx)
I20260809 07:58:34.449877 15473 webserver.cc:460] Webserver started at http://127.8.51.125:35377/ using document root <none> and password file <none>
I20260809 07:58:34.450455 15473 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.450515 15473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.450763 15473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:34.452834 15473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/instance:
uuid: "ec8bb99bd9e14ee391c6292163010b84"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "1377e0e3a65aff0fbde0248ad90ef9b6"
server_key_iv: "769237adf5923305fc43805a117a6194"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.453413 15473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal/instance:
uuid: "ec8bb99bd9e14ee391c6292163010b84"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "1377e0e3a65aff0fbde0248ad90ef9b6"
server_key_iv: "769237adf5923305fc43805a117a6194"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.457195 15473 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 07:58:34.459650 15490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.460896 15473 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:34.461133 15473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "ec8bb99bd9e14ee391c6292163010b84"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "1377e0e3a65aff0fbde0248ad90ef9b6"
server_key_iv: "769237adf5923305fc43805a117a6194"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.461247 15473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.474984 15473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.477962 15473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:34.478171 15473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:34.485256 15473 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.125:37403
I20260809 07:58:34.485530 15548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.125:37403 every 8 connection(s)
I20260809 07:58:34.486267 15473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
I20260809 07:58:34.488854 15549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:34.489643 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15473
I20260809 07:58:34.493355 15549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.125@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:34.504904 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.491272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37876 (local address 127.8.51.125:37403)
0809 07:58:34.491681 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.491703 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.491749 (+ 46us) server_negotiation.cc:407] Connection header received
0809 07:58:34.492572 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.492596 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.493031 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.493401 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.494214 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.495663 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.496691 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.497263 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.497376 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.500351 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.500358 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.500376 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.500397 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.502087 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.502549 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.502560 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.502565 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.502672 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.502976 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.502980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.502981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.503355 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.503573 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.503873 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.504141 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
I20260809 07:58:34.505066 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.495320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53344 (local address 127.8.51.126:36079)
0809 07:58:34.495470 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.495475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.495843 (+ 368us) server_negotiation.cc:407] Connection header received
0809 07:58:34.496001 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.496005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.496058 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.496150 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.496920 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.497489 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.498414 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.498830 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.498932 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.501830 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.501833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.501835 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.501856 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.503282 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.503757 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.503765 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.503766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.503838 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.504117 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.504122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.504123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.504340 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.504451 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.504789 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.504900 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:34.505142 15554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.495224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53344)
0809 07:58:34.495701 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.495753 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.495903 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.496206 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.496212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.496656 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.496801 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.496808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.497675 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.497677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.498292 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.498300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.498976 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.498978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.499055 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.499664 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.499690 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.501683 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.503401 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.503409 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.503415 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.503639 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.503930 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.503934 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.503936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.504034 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.504451 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.504459 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.504575 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.504720 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.504902 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":180,"threads_started":1}
I20260809 07:58:34.506703 15549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.125@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
I20260809 07:58:34.514477 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.507327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.8.51.125:37403)
0809 07:58:34.507431 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.507434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.507444 (+ 10us) server_negotiation.cc:407] Connection header received
0809 07:58:34.507471 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.507473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.507504 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.507564 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.508354 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.508830 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.509516 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.509785 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.509864 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.511599 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.511602 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.511604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.511623 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.512978 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.513340 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.513342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.513343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.513436 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.513738 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.513745 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.513746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.513973 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.514051 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.514275 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.514364 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:34.514477 15554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.507202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37890)
0809 07:58:34.507304 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.507317 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.507387 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.507590 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.507592 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.507725 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.508254 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.508261 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.508917 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.508919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.509402 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.509409 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.509883 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.509885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.509955 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.510325 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.510335 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.511486 (+ 1151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.513068 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.513070 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.513071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.513245 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.513528 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.513530 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.513532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.513661 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.514059 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.514061 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.514133 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.514218 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.514310 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 07:58:34.517381 15549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Bootstrap starting.
I20260809 07:58:34.520089 15549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:34.520818 15549 log.cc:824] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:34.522732 15549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: No bootstrap required, opened a new log
I20260809 07:58:34.525813 15549 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } }
I20260809 07:58:34.526033 15549 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:34.526109 15549 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8bb99bd9e14ee391c6292163010b84, State: Initialized, Role: FOLLOWER
I20260809 07:58:34.526538 15549 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } }
I20260809 07:58:34.527006 15556 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } } }
I20260809 07:58:34.527114 15556 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:34.527711 15549 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 07:58:34.532454 15567 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:34.532546 15567 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:34.535036 15473 master_runner.cc:428] Detected that this master ec8bb99bd9e14ee391c6292163010b84 is joining an existing cluster
I20260809 07:58:34.535099 15473 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.51.125:37403
I20260809 07:58:34.546391 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.537824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53360 (local address 127.8.51.126:36079)
0809 07:58:34.538047 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.538050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.538061 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:34.538092 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.538094 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.538129 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.538224 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.538882 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.539712 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.540769 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.541025 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.541136 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.542681 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.542687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.542693 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.542726 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.544406 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.544980 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.544984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.544986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.545082 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545409 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.545413 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.545414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.545683 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.545774 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.546113 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.546241 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260809 07:58:34.546396 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.537352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53360)
0809 07:58:34.537801 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.537815 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.537907 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.538352 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.538356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.538584 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.538737 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.538746 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.539825 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.539828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.540660 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.540667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.541261 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.541266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.541377 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.541956 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.541973 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.542520 (+ 547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.544519 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.544525 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.544527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.544864 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.545207 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.545215 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.545297 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.545815 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.545818 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.545928 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.546034 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.546171 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":65,"thread_start_us":84,"threads_started":1}
I20260809 07:58:34.546764 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.537920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37896 (local address 127.8.51.125:37403)
0809 07:58:34.538017 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.538021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.538032 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:34.538061 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.538064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.538102 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.538178 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.538983 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.539457 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.540594 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.540932 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.541040 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.542770 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.542773 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.542776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.542800 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.544954 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545366 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.545369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.545371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.545451 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545761 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.545764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.545766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.545962 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.546032 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.546320 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.546420 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":36,"spinlock_wait_cycles":768}
I20260809 07:58:34.547225 15573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.537352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37896)
0809 07:58:34.537731 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.537746 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.537839 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.538225 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.538227 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.538536 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.538873 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.538879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.539569 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.539572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.540461 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.540470 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.541069 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.541076 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.541178 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.542250 (+ 1072us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.542264 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.542625 (+ 361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.545043 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.545048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.545274 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.545547 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.545550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.545551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.545657 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.546088 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.546090 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.546176 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.546963 (+ 787us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.547082 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":141,"spinlock_wait_cycles":29056,"thread_start_us":120,"threads_started":1}
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.126@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
I20260809 07:58:34.560222 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.550775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37904)
0809 07:58:34.551113 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.551165 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.551315 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.551611 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.551617 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.551966 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.552066 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.552071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.552762 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.552767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.553528 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.553538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.554012 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.554015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.554138 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.554678 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.554694 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.556441 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.558599 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.558608 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.558615 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.558882 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.559165 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.559168 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.559169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.559248 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.559634 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.559640 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.559756 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.559890 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.560061 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
I20260809 07:58:34.560825 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.550822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37904 (local address 127.8.51.125:37403)
0809 07:58:34.550928 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.550932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.551240 (+ 308us) server_negotiation.cc:407] Connection header received
0809 07:58:34.551438 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.551441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.551491 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.551574 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.552186 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.552658 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.553690 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.553900 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.554009 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.556577 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.556581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.556583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.556606 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.558488 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.558987 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.558991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.558992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.559066 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.559338 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.559341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.559343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.559514 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.559587 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.560588 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.560691 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:34.562397 14978 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.51.125:37403: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84"
member_type: NON_VOTER
last_known_addr {
host: "127.8.51.125"
port: 37403
}
attrs {
promote: true
}
}
dest_uuid: "8119b7326f3e47fd902d890bf112b99d"
cas_config_opid_index: -1
I20260809 07:58:34.563014 14978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } }
I20260809 07:58:34.566071 15577 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } }
I20260809 07:58:34.566636 15518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:34.567796 15577 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.51.125:37403
I20260809 07:58:34.568049 15518 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Refusing update from remote peer 8119b7326f3e47fd902d890bf112b99d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 07:58:34.568037 15577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } }
I20260809 07:58:34.568245 15577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:34.568979 15473 master.cc:537] Master@127.8.51.125:37403 shutting down...
I20260809 07:58:34.568977 15577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 07:58:34.571283 14963 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 07:58:34.573320 15473 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:34.573633 15473 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:34.573760 15473 tablet_replica.cc:330] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: stopping tablet replica
I20260809 07:58:34.577932 15473 master.cc:552] Master@127.8.51.125:37403 shutdown complete.
I20260809 07:58:34.577996 15473 master_runner.cc:305] Clearing existing system tablet
I20260809 07:58:34.578214 15473 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.578285 15473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
WARNING: no policy specified for oryx/127.8.51.124@KRBTEST.COM; defaulting to no policy
I20260809 07:58:34.579699 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.579350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37910)
0809 07:58:34.579557 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.579628 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 07:58:34.579694 15473 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
W20260809 07:58:34.579921 14963 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d -> Peer ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125:37403): Couldn't send request to peer ec8bb99bd9e14ee391c6292163010b84. Status: Network error: Client connection negotiation failed: client connection to 127.8.51.125:37403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.124@KRBTEST.COM" created.
I20260809 07:58:34.581665 15582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.581861 15473 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.581969 15473 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:34.581995 15473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "ec8bb99bd9e14ee391c6292163010b84"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "1377e0e3a65aff0fbde0248ad90ef9b6"
server_key_iv: "769237adf5923305fc43805a117a6194"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.583920 15473 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:34.585999 15473 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 07:58:34.586102 15473 log.cc:1196] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 07:58:34.586376 15473 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Deleting consensus metadata
I20260809 07:58:34.586560 15473 master_runner.cc:315] Copying system tablet from 127.8.51.126:36079
I20260809 07:58:34.587615 15473 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: tablet copy: Beginning tablet copy session from remote peer at address 127.8.51.126:36079
I20260809 07:58:34.595731 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.588198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.8.51.126:36079)
0809 07:58:34.588309 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.588315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.588535 (+ 220us) server_negotiation.cc:407] Connection header received
0809 07:58:34.588674 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.588677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.588720 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.588808 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.589230 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.589875 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.590684 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.590907 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.591013 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.592408 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.592412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.592415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.592441 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.593949 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.594339 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.594343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.594345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.594431 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.594842 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.594845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.594847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.595047 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.595145 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.595468 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.595584 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 07:58:34.595794 15589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.588146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53362)
0809 07:58:34.588444 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.588456 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.588579 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.588825 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.588828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.589026 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.589116 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.589122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.589990 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.589994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.590547 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.590554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.591016 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.591019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.591109 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.591883 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.591900 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.592235 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.594050 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.594052 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.594054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.594242 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.594671 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.594673 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.594675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.594752 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.595171 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.595177 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.595305 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.595390 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.595523 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":93,"threads_started":1}
I20260809 07:58:34.596457 15000 tablet_copy_service.cc:140] P 8119b7326f3e47fd902d890bf112b99d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ec8bb99bd9e14ee391c6292163010b84 ({username='oryx', principal='oryx/127.8.51.125@KRBTEST.COM'} at 127.0.0.1:53362)
I20260809 07:58:34.596762 15000 tablet_copy_service.cc:161] P 8119b7326f3e47fd902d890bf112b99d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ec8bb99bd9e14ee391c6292163010b84 at {username='oryx', principal='oryx/127.8.51.125@KRBTEST.COM'} at 127.0.0.1:53362: session id = ec8bb99bd9e14ee391c6292163010b84-00000000000000000000000000000000
I20260809 07:58:34.598485 15000 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Tablet Copy: opened 0 blocks and 1 log segments
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.124.keytab.
Entry for principal oryx/127.8.51.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.124.keytab.
I20260809 07:58:34.600006 15473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 07:58:34.600518 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:40895
--webserver_interface=127.8.51.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.124.keytab
--principal=oryx/127.8.51.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 07:58:34.602207 15473 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: tablet copy: Starting download of 0 data blocks...
I20260809 07:58:34.602385 15473 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: tablet copy: Starting download of 1 WAL segments...
I20260809 07:58:34.604027 15473 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 07:58:34.606827 15000 tablet_copy_service.cc:342] P 8119b7326f3e47fd902d890bf112b99d: Request end of tablet copy session ec8bb99bd9e14ee391c6292163010b84-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.51.125@KRBTEST.COM'} at 127.0.0.1:53362
I20260809 07:58:34.606952 15000 tablet_copy_service.cc:433] P 8119b7326f3e47fd902d890bf112b99d: ending tablet copy session ec8bb99bd9e14ee391c6292163010b84-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ec8bb99bd9e14ee391c6292163010b84
I20260809 07:58:34.621979 15473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:34.623689 15591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.626689 15592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.626780 15594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:34.626965 15473 server_base.cc:1034] running on GCE node
I20260809 07:58:34.627208 15473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:34.627518 15473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:34.628679 15473 hybrid_clock.cc:648] HybridClock initialized: now 1786262314628657 us; error 39 us; skew 500 ppm
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:34.630337 15473 init.cc:377] Logged in from keytab as oryx/127.8.51.125@KRBTEST.COM (short username oryx)
I20260809 07:58:34.630793 15473 webserver.cc:460] Webserver started at http://127.8.51.125:32771/ using document root <none> and password file <none>
I20260809 07:58:34.631003 15473 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.631045 15473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.632390 15473 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:34.633440 15601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.633762 15473 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:34.633852 15473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "ec8bb99bd9e14ee391c6292163010b84"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "1377e0e3a65aff0fbde0248ad90ef9b6"
server_key_iv: "769237adf5923305fc43805a117a6194"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.633936 15473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.646268 15473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.648470 15473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:34.653311 15473 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.125:37403
I20260809 07:58:34.654039 15473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
I20260809 07:58:34.655840 15658 sys_catalog.cc:263] Verifying existing consensus state
I20260809 07:58:34.656993 15658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Bootstrap starting.
I20260809 07:58:34.661731 15657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.125:37403 every 8 connection(s)
I20260809 07:58:34.668124 15658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 07:58:34.668464 15658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: Bootstrap complete.
I20260809 07:58:34.669116 15658 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } }
I20260809 07:58:34.669273 15658 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ec8bb99bd9e14ee391c6292163010b84, State: Initialized, Role: LEARNER
I20260809 07:58:34.669387 15658 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } }
I20260809 07:58:34.669775 15662 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } }
I20260809 07:58:34.669909 15658 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:34.669950 15662 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: LEARNER
I20260809 07:58:34.673404 15674 catalog_manager.cc:1259] Loaded cluster ID: 757cf027b1594bd2b5f5d54ed01b0a95
I20260809 07:58:34.673466 15674 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: loading cluster ID for follower catalog manager: success
I20260809 07:58:34.675499 15674 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: acquiring CA information for follower catalog manager: success
I20260809 07:58:34.676883 15674 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 07:58:34.732211 15590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:34.732452 15590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:34.732491 15590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:34.736779 15590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:34.736832 15590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:34.736851 15590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:34.736867 15590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:34.736881 15590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:34.742429 15590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.124.keytab
--principal=oryx/127.8.51.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:40895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.51.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:34.743593 15590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:34.744807 15590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:34.753283 15679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.753288 15680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.753300 15682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:34.753724 15590 server_base.cc:1034] running on GCE node
I20260809 07:58:34.754261 15590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:34.755342 15590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:34.756502 15590 hybrid_clock.cc:648] HybridClock initialized: now 1786262314756466 us; error 49 us; skew 500 ppm
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:34.759362 15590 init.cc:377] Logged in from keytab as oryx/127.8.51.124@KRBTEST.COM (short username oryx)
I20260809 07:58:34.760200 15590 webserver.cc:460] Webserver started at http://127.8.51.124:36597/ using document root <none> and password file <none>
I20260809 07:58:34.760710 15590 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.760766 15590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.760993 15590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:34.763135 15590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/instance:
uuid: "5879958135eb4f75866b1b5d964f48e5"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "e4ee58587367057a77e3ec3c37238b15"
server_key_iv: "c09ae510f050a7715ead3e1f082f8395"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.763846 15590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal/instance:
uuid: "5879958135eb4f75866b1b5d964f48e5"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "e4ee58587367057a77e3ec3c37238b15"
server_key_iv: "c09ae510f050a7715ead3e1f082f8395"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.767706 15590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:58:34.770138 15691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.771687 15590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:34.771852 15590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "5879958135eb4f75866b1b5d964f48e5"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "e4ee58587367057a77e3ec3c37238b15"
server_key_iv: "c09ae510f050a7715ead3e1f082f8395"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.771962 15590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.791409 15590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.794575 15590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:34.794767 15590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:34.802100 15590 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.124:40895
I20260809 07:58:34.802376 15746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.124:40895 every 8 connection(s)
I20260809 07:58:34.803108 15590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
I20260809 07:58:34.805924 15747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:34.808883 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15590
I20260809 07:58:34.809756 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.124@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:34.822844 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.811787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53364 (local address 127.8.51.126:36079)
0809 07:58:34.811904 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.811908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.812071 (+ 163us) server_negotiation.cc:407] Connection header received
0809 07:58:34.812341 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.812344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.812396 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.812476 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.813521 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.814350 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.815647 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.815970 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.816075 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.819625 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.819633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.819635 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.819658 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.820910 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821395 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.821402 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.821404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.821490 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821842 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.821848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.821851 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.822044 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.822168 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.822521 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.822656 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 07:58:34.823644 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.811594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53364)
0809 07:58:34.811927 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.811974 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.812150 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.812551 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.812559 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.813031 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.813388 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.813401 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.814480 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.814485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.815527 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.815538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.816121 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.816125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.816300 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.817229 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.817247 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.819461 (+ 2214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.821026 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821052 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.821062 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.821292 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.821620 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.821625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.821747 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.822167 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.822173 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.822304 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.822471 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.822906 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":109,"thread_start_us":115,"threads_started":1}
I20260809 07:58:34.823645 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.810452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39010 (local address 127.8.51.124:40895)
0809 07:58:34.810848 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.810866 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.810909 (+ 43us) server_negotiation.cc:407] Connection header received
0809 07:58:34.811721 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.811745 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.812171 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.812393 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.813316 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.814604 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.815576 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.816144 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.816301 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.819027 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.819037 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.819052 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.819079 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.820934 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821397 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.821407 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.821408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.821509 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.821815 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.821819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.821821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.822176 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.822374 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.822596 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.822818 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":118,"threads_started":1}
I20260809 07:58:34.824998 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.124@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
I20260809 07:58:34.832952 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.825567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37912)
0809 07:58:34.826009 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.826021 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.826080 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.826286 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.826289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.826414 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.826494 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.826498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.827323 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.827326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.827830 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.827836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.828232 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.828235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.828304 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.828740 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.828771 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.829909 (+ 1138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.831471 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.831475 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.831477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.831671 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.831966 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.831970 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.831972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.832054 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.832431 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.832434 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.832529 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.832674 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.832797 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348}
I20260809 07:58:34.833001 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.825800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.8.51.125:37403)
0809 07:58:34.826043 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.826047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.826061 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:34.826146 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.826148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.826185 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.826259 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.826591 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.827237 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.827922 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.828144 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.828218 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.830044 (+ 1826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.830047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.830050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.830075 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.831367 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.831773 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.831776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.831778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.831877 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.832160 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.832163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.832165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.832337 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.832440 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.832726 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.832844 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":96,"threads_started":1}
I20260809 07:58:34.833825 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.124@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
I20260809 07:58:34.839341 15180 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
I20260809 07:58:34.841763 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.834406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.8.51.124:40895)
0809 07:58:34.834517 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.834533 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.834551 (+ 18us) server_negotiation.cc:407] Connection header received
0809 07:58:34.834578 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.834580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.834610 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.834673 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.835003 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.835546 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.836574 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.836795 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.836868 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.838688 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.838690 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.838692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.838711 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.840187 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.840648 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.840650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.840651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.840720 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.840984 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.840989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.840990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.841152 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.841251 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.841480 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.841629 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":48}
I20260809 07:58:34.841763 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.834325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39020)
0809 07:58:34.834413 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.834427 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.834500 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.834724 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.834727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.834863 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.834929 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.834933 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.835991 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.835993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.836479 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.836486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.836887 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.836890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.836944 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.837399 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.837411 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.838573 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.840288 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.840291 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.840293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.840529 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.840810 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.840815 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.840817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.840898 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.841243 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.841245 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.841323 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.841429 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.841556 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 07:58:34.844547 15747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Bootstrap starting.
I20260809 07:58:34.846807 15747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:34.847472 15747 log.cc:824] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:34.849220 15747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: No bootstrap required, opened a new log
I20260809 07:58:34.852146 15747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } }
I20260809 07:58:34.852332 15747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:34.852363 15747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5879958135eb4f75866b1b5d964f48e5, State: Initialized, Role: FOLLOWER
I20260809 07:58:34.852725 15747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } }
I20260809 07:58:34.853101 15754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } } }
I20260809 07:58:34.853245 15754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:34.853891 15747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 07:58:34.858569 15765 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:58:34.858676 15765 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:58:34.862175 15590 master_runner.cc:428] Detected that this master 5879958135eb4f75866b1b5d964f48e5 is joining an existing cluster
I20260809 07:58:34.862251 15590 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.51.124:40895
I20260809 07:58:34.876972 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15046
I20260809 07:58:34.886543 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:35919
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:36079
--webserver_port=34435
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 07:58:34.887058 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.864287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53380 (local address 127.8.51.126:36079)
0809 07:58:34.864446 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.864451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.864733 (+ 282us) server_negotiation.cc:407] Connection header received
0809 07:58:34.864995 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.864999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.865046 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.865099 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.865961 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.866786 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868052 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.868396 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868481 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.869948 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.869954 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.869957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.869985 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.871934 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.872439 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.872443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.872445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.872532 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.885950 (+ 13418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.885954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.885956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.886273 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.886353 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.886721 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.886853 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 07:58:34.887238 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.864719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39036 (local address 127.8.51.124:40895)
0809 07:58:34.864822 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.864825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.866957 (+ 2132us) server_negotiation.cc:407] Connection header received
0809 07:58:34.867088 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.867091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.867122 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.867175 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.867673 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.868385 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.869448 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.869792 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.869917 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.871400 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.871405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.871408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.871434 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.873068 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.886073 (+ 13005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.886076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.886077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.886145 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.886431 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.886433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.886435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.886604 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.886683 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.886982 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.887093 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 07:58:34.887605 15771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.864233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53380)
0809 07:58:34.864651 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.864666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.864880 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.865257 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.865260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.865563 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.865865 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.865873 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.866902 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.866907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.867917 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.867928 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.868653 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.868787 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.869319 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.869334 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.869803 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.872061 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.872068 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.872072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.872357 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.872644 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.872648 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.872650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.885815 (+ 13165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.886425 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.886428 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.886523 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.887261 (+ 738us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.887424 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":71,"thread_start_us":94,"threads_started":1}
I20260809 07:58:34.887638 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.864679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39036)
0809 07:58:34.865903 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.866904 (+ 1001us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.867006 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.867279 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.867281 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.867460 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.867562 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.867569 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.868498 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.869317 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.869327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.870323 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.870329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.870435 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.870804 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.870819 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.871261 (+ 442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.873176 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.873179 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.873182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.885981 (+ 12799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.886242 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.886245 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.886247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.886346 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.886743 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.886745 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.886834 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.887390 (+ 556us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.887488 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260809 07:58:34.892395 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.865001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.8.51.125:37403)
0809 07:58:34.865110 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.865114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.865125 (+ 11us) server_negotiation.cc:407] Connection header received
0809 07:58:34.865172 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.865174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.865209 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.865293 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.866161 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.866669 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868538 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.868894 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.868979 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.888374 (+ 19395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.888378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.888380 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.888409 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.890637 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.891089 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.891093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.891096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.891197 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.891506 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.891512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.891516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.891731 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.891788 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.892131 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.892286 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:58:34.892937 15773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.864248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37928)
0809 07:58:34.864907 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.864922 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.865007 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.865309 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.865311 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.865633 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.866033 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.866037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.866773 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.866779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.868412 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.868423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.869113 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.869116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.869222 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.887793 (+ 18571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.887809 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.888183 (+ 374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.890753 (+ 2570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.890759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.890763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.890956 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.891313 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.891315 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.891316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.891382 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.891849 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.891851 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.891916 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.892600 (+ 684us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.892757 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":29,"spinlock_wait_cycles":12160,"thread_start_us":134,"threads_started":1}
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262313, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.126@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
I20260809 07:58:34.901366 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.892861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39050 (local address 127.8.51.124:40895)
0809 07:58:34.892962 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.892967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.892982 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:34.893051 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.893056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.893108 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.893173 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.893987 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.894584 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.895362 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.895588 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.895721 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.897553 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.897556 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.897559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.897686 (+ 127us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.899060 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.900194 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.900196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.900197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.900267 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.900561 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.900565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.900567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.900780 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.900885 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.901124 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.901220 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:34.901371 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.892629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39050)
0809 07:58:34.892872 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.892885 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.892950 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.893422 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.893426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.893626 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.893750 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.893758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.894701 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.894706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.895246 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.895253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.895723 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.895727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.895821 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.896249 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.896268 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.897431 (+ 1163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.899851 (+ 2420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.899855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.899857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.900058 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.900355 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.900358 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.900360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.900448 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.900878 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.900881 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.900970 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.901074 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.901221 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
I20260809 07:58:34.902541 14978 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.51.124:40895: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5879958135eb4f75866b1b5d964f48e5"
member_type: NON_VOTER
last_known_addr {
host: "127.8.51.124"
port: 40895
}
attrs {
promote: true
}
}
dest_uuid: "8119b7326f3e47fd902d890bf112b99d"
cas_config_opid_index: 5
I20260809 07:58:34.903102 14978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } }
I20260809 07:58:34.904174 15578 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.905351 15578 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.51.124:40895
I20260809 07:58:34.905514 15578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.905679 15578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:34.906090 15590 master.cc:537] Master@127.8.51.124:40895 shutting down...
W20260809 07:58:34.907856 14963 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d -> Peer 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124:40895): Couldn't send request to peer 5879958135eb4f75866b1b5d964f48e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 07:58:34.911182 15590 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:34.911470 15590 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:34.911566 15590 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: stopping tablet replica
I20260809 07:58:34.912498 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.906194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37936)
0809 07:58:34.908193 (+ 1999us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.908208 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.908290 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.908756 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.908760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.908774 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:34.908835 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.908839 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.909716 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.909720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.910958 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.910973 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.912039 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.912043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.912136 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.912211 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.912287 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.912359 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1928}
I20260809 07:58:34.912892 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.906439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.8.51.125:37403)
0809 07:58:34.908100 (+ 1661us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.908104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.908372 (+ 268us) server_negotiation.cc:407] Connection header received
0809 07:58:34.908427 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.908431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.908498 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.908617 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:34.908946 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.909615 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.911108 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.911718 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.911817 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.911969 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.912706 (+ 737us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.912786 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1578}
I20260809 07:58:34.913336 15630 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 LEARNER]: Refusing update from remote peer 8119b7326f3e47fd902d890bf112b99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 07:58:34.913856 15577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 07:58:34.915952 15630 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.918063 15590 master.cc:552] Master@127.8.51.124:40895 shutdown complete.
I20260809 07:58:34.918152 15590 master_runner.cc:305] Clearing existing system tablet
I20260809 07:58:34.918475 15590 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.918583 15590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.918687 15662 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8119b7326f3e47fd902d890bf112b99d. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.918805 15662 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: LEARNER
I20260809 07:58:34.918902 15662 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: NON_VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: true } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.919006 15662 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: LEARNER
I20260809 07:58:34.920068 15590 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:34.920943 15778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.921132 15590 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.921276 15590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:34.921314 15590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "5879958135eb4f75866b1b5d964f48e5"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "e4ee58587367057a77e3ec3c37238b15"
server_key_iv: "c09ae510f050a7715ead3e1f082f8395"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.922848 15577 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: attempting to promote NON_VOTER ec8bb99bd9e14ee391c6292163010b84 to VOTER
I20260809 07:58:34.923266 15577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } }
I20260809 07:58:34.923614 15590 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:34.924736 15630 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 LEARNER]: Refusing update from remote peer 8119b7326f3e47fd902d890bf112b99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 07:58:34.924819 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.924241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39062)
0809 07:58:34.924683 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.924742 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344}
I20260809 07:58:34.925119 15578 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 07:58:34.925750 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.925365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39064)
0809 07:58:34.925630 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.925690 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
W20260809 07:58:34.925858 14963 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d -> Peer 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124:40895): Couldn't send request to peer 5879958135eb4f75866b1b5d964f48e5. Status: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 07:58:34.926759 15577 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.928930 15590 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 07:58:34.929014 15590 log.cc:1196] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 07:58:34.928884 15630 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.929289 15590 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Deleting consensus metadata
I20260809 07:58:34.929446 15590 master_runner.cc:315] Copying system tablet from 127.8.51.126:36079
I20260809 07:58:34.930589 15590 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: tablet copy: Beginning tablet copy session from remote peer at address 127.8.51.126:36079
I20260809 07:58:34.930553 15776 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.930668 15776 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:34.931232 15578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.931337 15578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:34.931561 15577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:34.931677 15577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:34.941527 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.934052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53392 (local address 127.8.51.126:36079)
0809 07:58:34.934170 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:34.934196 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:34.934510 (+ 314us) server_negotiation.cc:407] Connection header received
0809 07:58:34.934682 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:34.934686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:34.934730 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:34.934823 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:34.935382 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.935920 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.936760 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.936981 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.937093 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.938241 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:34.938245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:34.938247 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:34.938271 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:34.939853 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.940283 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.940286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.940288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.940372 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:34.940696 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:34.940699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:34.940701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:34.940879 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:34.940985 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:34.941262 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 07:58:34.941381 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 07:58:34.941545 15786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:34.934053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53392)
0809 07:58:34.934415 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:34.934429 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:34.934571 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:34.934841 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:34.934844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:34.935053 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:34.935218 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.935224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.936031 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.936035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.936627 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:34.936635 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:34.937088 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:34.937092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:34.937187 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:34.937760 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:34.937781 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:34.938096 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:34.939970 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.939973 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.939975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.940181 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.940466 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:34.940470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:34.940472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:34.940611 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:34.940977 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:34.940980 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:34.941082 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 07:58:34.941190 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 07:58:34.941356 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":112,"threads_started":1}
I20260809 07:58:34.942374 15000 tablet_copy_service.cc:140] P 8119b7326f3e47fd902d890bf112b99d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5879958135eb4f75866b1b5d964f48e5 ({username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:53392)
I20260809 07:58:34.942484 15000 tablet_copy_service.cc:161] P 8119b7326f3e47fd902d890bf112b99d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5879958135eb4f75866b1b5d964f48e5 at {username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:53392: session id = 5879958135eb4f75866b1b5d964f48e5-00000000000000000000000000000000
I20260809 07:58:34.943262 15000 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 07:58:34.944401 15590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 07:58:34.946326 15590 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: tablet copy: Starting download of 0 data blocks...
I20260809 07:58:34.946540 15590 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: tablet copy: Starting download of 1 WAL segments...
I20260809 07:58:34.947898 15590 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 07:58:34.949328 15000 tablet_copy_service.cc:342] P 8119b7326f3e47fd902d890bf112b99d: Request end of tablet copy session 5879958135eb4f75866b1b5d964f48e5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:53392
I20260809 07:58:34.949414 15000 tablet_copy_service.cc:433] P 8119b7326f3e47fd902d890bf112b99d: ending tablet copy session 5879958135eb4f75866b1b5d964f48e5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5879958135eb4f75866b1b5d964f48e5
I20260809 07:58:34.955988 15590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:34.957625 15787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.957749 15788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:34.957855 15790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:34.958820 15590 server_base.cc:1034] running on GCE node
I20260809 07:58:34.959004 15590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:34.959332 15590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:34.960472 15590 hybrid_clock.cc:648] HybridClock initialized: now 1786262314960481 us; error 40 us; skew 500 ppm
Aug 09 07:58:34 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262314, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:34.962121 15590 init.cc:377] Logged in from keytab as oryx/127.8.51.124@KRBTEST.COM (short username oryx)
I20260809 07:58:34.962574 15590 webserver.cc:460] Webserver started at http://127.8.51.124:42839/ using document root <none> and password file <none>
I20260809 07:58:34.962785 15590 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:34.962841 15590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:34.964079 15590 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:34.965032 15798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:34.965273 15590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:34.965368 15590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "5879958135eb4f75866b1b5d964f48e5"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "e4ee58587367057a77e3ec3c37238b15"
server_key_iv: "c09ae510f050a7715ead3e1f082f8395"
server_key_version: "encryptionkey@0"
I20260809 07:58:34.965451 15590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:34.994540 15590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:34.996630 15590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:35.001626 15590 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.124:40895
I20260809 07:58:35.001778 15855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.124:40895 every 8 connection(s)
I20260809 07:58:35.002202 15590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
I20260809 07:58:35.003634 15856 sys_catalog.cc:263] Verifying existing consensus state
I20260809 07:58:35.004478 15856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Bootstrap starting.
I20260809 07:58:35.013244 15856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 07:58:35.013607 15856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Bootstrap complete.
I20260809 07:58:35.014187 15856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } }
I20260809 07:58:35.014324 15856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5879958135eb4f75866b1b5d964f48e5, State: Initialized, Role: LEARNER
I20260809 07:58:35.014569 15856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } }
I20260809 07:58:35.014909 15859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:35.015074 15859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: LEARNER
I20260809 07:58:35.015074 15856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:35.018558 15870 catalog_manager.cc:1259] Loaded cluster ID: 757cf027b1594bd2b5f5d54ed01b0a95
I20260809 07:58:35.018677 15870 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: loading cluster ID for follower catalog manager: success
I20260809 07:58:35.020076 15870 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: acquiring CA information for follower catalog manager: success
I20260809 07:58:35.021108 15870 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 07:58:35.049114 15774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:35.049469 15774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:35.049531 15774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:35.055546 15774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:35.055647 15774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:35.055759 15774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:35.058301 15320 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
I20260809 07:58:35.063714 15774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:35919
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=34435
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:35.065025 15774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:35.066382 15774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:35.077490 15875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.077508 15876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.077507 15878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:35.078279 15774 server_base.cc:1034] running on GCE node
I20260809 07:58:35.078617 15774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:35.079280 15774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:35.080459 15774 hybrid_clock.cc:648] HybridClock initialized: now 1786262315080447 us; error 22 us; skew 500 ppm
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:35.083216 15774 init.cc:377] Logged in from keytab as oryx/127.8.51.65@KRBTEST.COM (short username oryx)
I20260809 07:58:35.084069 15774 webserver.cc:460] Webserver started at http://127.8.51.65:34435/ using document root <none> and password file <none>
I20260809 07:58:35.084650 15774 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:35.084759 15774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:35.088711 15774 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:35.090791 15885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.091922 15774 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:35.092053 15774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "e1f4866b414f4baab81a9aefa4326b5f"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "5435f0569ded7db4d5401161a73bade6"
server_key_iv: "4b54174d17abda0051ec284bb86a5295"
server_key_version: "encryptionkey@0"
I20260809 07:58:35.092586 15774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:35.104534 15774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:35.107275 15774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:35.107465 15774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:35.108016 15774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:35.108820 15774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:35.108887 15774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.108958 15774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:35.109001 15774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.119005 15774 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:35919
I20260809 07:58:35.119032 16007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:35919 every 8 connection(s)
I20260809 07:58:35.119985 15774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:35.123375 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 15774
I20260809 07:58:35.123582 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15185
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:35.139381 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.121857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:60375 (local address 127.8.51.126:36079)
0809 07:58:35.122093 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.122098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.129169 (+ 7071us) server_negotiation.cc:407] Connection header received
0809 07:58:35.129321 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.129324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.129381 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.129469 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.129965 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.130659 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.131506 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.131737 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.131848 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.135122 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.135125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.135128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.135154 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.136753 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.137492 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.137495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.137497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.137642 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.138079 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.138083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.138084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.138307 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.138416 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.139084 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.139211 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
I20260809 07:58:35.139499 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.121857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:37943 (local address 127.8.51.124:40895)
0809 07:58:35.122092 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.122107 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.123186 (+ 1079us) server_negotiation.cc:407] Connection header received
0809 07:58:35.124633 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.124639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.124707 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.124783 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.126908 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.127897 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.130274 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.130639 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.130757 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.134910 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.134917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.134923 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.134959 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.136876 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.137485 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.137492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.137496 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.137618 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.138354 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.138358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.138363 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.138597 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.138697 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.139069 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.139230 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":80,"threads_started":1}
I20260809 07:58:35.141270 16013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.122448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:60375)
0809 07:58:35.123013 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.123075 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.129213 (+ 6138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.129484 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.129487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.129736 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.129846 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.129851 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.130784 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.130788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.131383 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.131391 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.131851 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.131854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.131950 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.132431 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.132442 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.134987 (+ 2545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.136877 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.136885 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.136902 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.137364 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.137755 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.137761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.137766 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.137958 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.138417 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.138424 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.138751 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.139940 (+ 1189us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.140188 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":101,"spinlock_wait_cycles":2432,"thread_start_us":152,"threads_started":1}
I20260809 07:58:35.142159 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:46611
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:36079
--webserver_port=37451
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
I20260809 07:58:35.142999 16009 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:35.143267 16009 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.141273 16014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.122446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.8.51.65:37943)
0809 07:58:35.123013 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.123075 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.124356 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.125124 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.125140 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.125826 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.126703 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.126733 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.128041 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.128047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.130117 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.130132 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.130820 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.130830 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.131131 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.131920 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.131953 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.134711 (+ 2758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.136988 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.136994 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.136996 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.137364 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.138174 (+ 810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.138176 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.138178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.138246 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.138714 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.138717 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.138831 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.139707 (+ 876us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.140108 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":34,"spinlock_wait_cycles":54912,"thread_start_us":145,"threads_started":1}
I20260809 07:58:35.143879 16009 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:35.145267 16008 heartbeater.cc:347] Connected to a master server at 127.8.51.124:40895
I20260809 07:58:35.145304 14978 ts_manager.cc:194] Re-registered known tserver with Master: e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65:35919)
I20260809 07:58:35.145361 16008 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.145558 16008 heartbeater.cc:511] Master 127.8.51.124:40895 requested a full tablet report, sending...
I20260809 07:58:35.146155 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:60375
I20260809 07:58:35.146824 15817 ts_manager.cc:194] Registered new tserver with Master: e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65:35919)
I20260809 07:58:35.147444 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.123545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.8.51.65:41017)
0809 07:58:35.123999 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.124014 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.124374 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.134268 (+ 9894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.134272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.134441 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.134641 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.134651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.138848 (+ 4197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.138851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.139770 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.139781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.140518 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.140522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.140622 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.141092 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.141106 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.143256 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.145478 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.145481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.145483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.145759 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.146192 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.146196 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.146198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.146291 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.146805 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.146808 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.146974 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.147085 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.147259 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":96,"threads_started":1}
I20260809 07:58:35.148082 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.125992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:41017 (local address 127.8.51.125:37403)
0809 07:58:35.133865 (+ 7873us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.133873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.133892 (+ 19us) server_negotiation.cc:407] Connection header received
0809 07:58:35.133976 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.133998 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.134061 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.134186 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.137980 (+ 3794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.138732 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.139917 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.140258 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.140338 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.143398 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.143401 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.143404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.143431 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.145282 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.145942 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.145946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.145947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.146044 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.146445 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.146449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.146451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.146666 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.146757 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.147785 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.147948 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7759}
I20260809 07:58:35.148953 16010 heartbeater.cc:347] Connected to a master server at 127.8.51.125:37403
I20260809 07:58:35.149053 16010 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.149296 16010 heartbeater.cc:511] Master 127.8.51.125:37403 requested a full tablet report, sending...
I20260809 07:58:35.150516 15618 ts_manager.cc:194] Registered new tserver with Master: e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65:35919)
W20260809 07:58:35.256364 16016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:35.256678 16016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:35.256758 16016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:35.260774 16016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:35.260866 16016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:35.260960 16016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:35.267666 16016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:46611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=37451
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:35.268748 16016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:35.269836 16016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:35.279603 16024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.279639 16021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.279676 16022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:35.279927 16016 server_base.cc:1034] running on GCE node
I20260809 07:58:35.280357 16016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:35.280946 16016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:35.282119 16016 hybrid_clock.cc:648] HybridClock initialized: now 1786262315282084 us; error 47 us; skew 500 ppm
I20260809 07:58:35.283012 15466 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:35.285140 16016 init.cc:377] Logged in from keytab as oryx/127.8.51.66@KRBTEST.COM (short username oryx)
I20260809 07:58:35.286043 16016 webserver.cc:460] Webserver started at http://127.8.51.66:37451/ using document root <none> and password file <none>
I20260809 07:58:35.286540 16016 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:35.286612 16016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:35.290277 16016 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:35.292323 16031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.293495 16016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:35.293632 16016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "d7b9d71a26a047279fbce739a3cca873"
format_stamp: "Formatted at 2026-08-09 07:58:33 on dist-test-slave-njxd"
server_key: "b142dd3bd4ca5b702390b383ff81c95a"
server_key_iv: "6291ae4894cf77aa0d78efa5f8f08546"
server_key_version: "encryptionkey@0"
I20260809 07:58:35.294154 16016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:35.322417 16016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:35.325930 16016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:35.326138 16016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:35.326740 16016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:35.327592 16016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:35.327639 16016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.327706 16016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:35.327737 16016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.337018 16016 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:46611
I20260809 07:58:35.337045 16153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:46611 every 8 connection(s)
I20260809 07:58:35.338039 16016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:35.341625 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16016
I20260809 07:58:35.341796 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15325
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
I20260809 07:58:35.356799 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.339731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:60301 (local address 127.8.51.126:36079)
0809 07:58:35.339859 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.339864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.340784 (+ 920us) server_negotiation.cc:407] Connection header received
0809 07:58:35.342080 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.342084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.342142 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.342196 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.344248 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.345063 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347183 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.347514 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347598 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.352129 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.352133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.352135 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.352163 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.354447 (+ 2284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.354942 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.354945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.354947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.355028 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355388 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.355391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.355393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.355608 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.355693 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.356501 (+ 808us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.356627 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:58:35.356799 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.341327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:42795 (local address 127.8.51.124:40895)
0809 07:58:35.341454 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.341460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.341546 (+ 86us) server_negotiation.cc:407] Connection header received
0809 07:58:35.342086 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.342089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.342142 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.342196 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.344250 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.345071 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347183 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.347526 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347598 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.352161 (+ 4563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.352164 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.352167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.352195 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.354172 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.354871 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.354877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.354879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.354972 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355388 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.355391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.355393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.355615 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.355693 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.356501 (+ 808us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.356637 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:35.357033 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.339765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36935 (local address 127.8.51.125:37403)
0809 07:58:35.339937 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.339942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.340782 (+ 840us) server_negotiation.cc:407] Connection header received
0809 07:58:35.342073 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.342080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.342144 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.342203 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.347450 (+ 5247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.348530 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.350082 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.350433 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.350540 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.353044 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.353050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.353056 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.353113 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.355011 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355544 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.355550 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.355555 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.355642 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355956 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.355961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.355966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.356222 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.356304 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.356659 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.356795 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 07:58:35.358587 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.340170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:60301)
0809 07:58:35.340629 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.340683 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.341872 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.342601 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.342610 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.343175 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.344073 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.344093 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.345227 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.345230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.347045 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.347055 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.347797 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.348079 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.348842 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.348867 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.351987 (+ 3120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.354579 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.354582 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.354585 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.354836 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.355146 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355149 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.355151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.355276 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.355776 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.355783 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.356199 (+ 416us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.356960 (+ 761us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.357370 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":487,"spinlock_wait_cycles":67072,"thread_start_us":150,"threads_started":1}
I20260809 07:58:35.358587 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.340170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.8.51.66:36935)
0809 07:58:35.340629 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.340684 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.341834 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.342605 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.342611 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.347100 (+ 4489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.347270 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.347284 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.348712 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.348719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.349928 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.349943 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.350690 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.350694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.350797 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.351308 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.351324 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.352885 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.355140 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355147 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.355152 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.355432 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.355763 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355769 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.355774 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.355862 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.356367 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.356373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.356477 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.357204 (+ 727us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.357473 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":90,"spinlock_wait_cycles":3456,"thread_start_us":132,"threads_started":1}
I20260809 07:58:35.359766 16156 heartbeater.cc:347] Connected to a master server at 127.8.51.125:37403
I20260809 07:58:35.359989 16155 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:35.360033 16156 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.360015 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.341187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.8.51.66:42795)
0809 07:58:35.341447 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.341461 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.341844 (+ 383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.342601 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.342610 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.343175 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.344073 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.344093 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.345227 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.345230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.347045 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.347055 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.347797 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.347801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.348081 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.348943 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.348962 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.351624 (+ 2662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.354320 (+ 2696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.354327 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.354345 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.354749 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.355089 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.355094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.355096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.355276 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.355776 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.355783 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.356199 (+ 416us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.357522 (+ 1323us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.357672 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":434,"spinlock_wait_cycles":14976,"thread_start_us":93,"threads_started":1}
I20260809 07:58:35.360090 16155 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.360397 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:40323
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:36079
--webserver_port=36759
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 07:58:35.360644 16155 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:35.360644 16156 heartbeater.cc:511] Master 127.8.51.125:37403 requested a full tablet report, sending...
I20260809 07:58:35.361025 16154 heartbeater.cc:347] Connected to a master server at 127.8.51.124:40895
I20260809 07:58:35.361135 16154 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.361325 16154 heartbeater.cc:511] Master 127.8.51.124:40895 requested a full tablet report, sending...
I20260809 07:58:35.361769 14978 ts_manager.cc:194] Re-registered known tserver with Master: d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:35.361832 15618 ts_manager.cc:194] Registered new tserver with Master: d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:35.361984 15817 ts_manager.cc:194] Registered new tserver with Master: d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:35.362581 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:60301
I20260809 07:58:35.436124 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.431933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39066 (local address 127.8.51.124:40895)
0809 07:58:35.432081 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.432086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.432270 (+ 184us) server_negotiation.cc:407] Connection header received
0809 07:58:35.432448 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.432469 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.432566 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.432683 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.432964 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.433778 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.435044 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.435566 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.435693 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.435865 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.435923 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.435993 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:35.436125 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.431800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39066)
0809 07:58:35.432168 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.432181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.432326 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.432709 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.432712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.432733 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.432853 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.432858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.433893 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.433896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.434919 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.434930 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.435698 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.435702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.435795 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.435819 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.435889 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.435972 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":74,"threads_started":1}
I20260809 07:58:35.437011 15828 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 07:58:35.437726 15859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8119b7326f3e47fd902d890bf112b99d. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:35.437875 15859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: LEARNER
W20260809 07:58:35.476583 16161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:35.476884 16161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:35.476959 16161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:35.481449 16161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:35.481515 16161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:35.481628 16161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:35.486949 16161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:40323
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=36759
--tserver_master_addrs=127.8.51.126:36079,127.8.51.125:37403,127.8.51.124:40895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:35.487902 16161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:35.488904 16161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:35.498311 16167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.498322 16168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:35.498322 16170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:35.498824 16161 server_base.cc:1034] running on GCE node
I20260809 07:58:35.499259 16161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:35.499852 16161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:35.501003 16161 hybrid_clock.cc:648] HybridClock initialized: now 1786262315500970 us; error 42 us; skew 500 ppm
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:35.503687 16161 init.cc:377] Logged in from keytab as oryx/127.8.51.67@KRBTEST.COM (short username oryx)
I20260809 07:58:35.504508 16161 webserver.cc:460] Webserver started at http://127.8.51.67:36759/ using document root <none> and password file <none>
I20260809 07:58:35.505096 16161 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:35.505237 16161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:35.509024 16161 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:35.511058 16177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.512216 16161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:35.512333 16161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "f592223a687d4ae5be44bd518655fc2c"
format_stamp: "Formatted at 2026-08-09 07:58:34 on dist-test-slave-njxd"
server_key: "23a3df5545aa2183d8dbdf5c36fa9724"
server_key_iv: "dcf69a89508a9545fc1fc180dc597874"
server_key_version: "encryptionkey@0"
I20260809 07:58:35.512851 16161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:35.551519 16161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:35.554669 16161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:35.554872 16161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:35.555554 16161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:35.556578 16161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:35.556638 16161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.556685 16161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:35.556715 16161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:35.568094 16161 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:40323
I20260809 07:58:35.568114 16303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:40323 every 8 connection(s)
I20260809 07:58:35.569175 16161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:35.578727 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16161
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.125@KRBTEST.COM
Aug 09 07:58:35 dist-test-slave-njxd krb5kdc[14929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262315, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.124@KRBTEST.COM
I20260809 07:58:35.585770 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.571153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38739 (local address 127.8.51.125:37403)
0809 07:58:35.571355 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.571360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.572283 (+ 923us) server_negotiation.cc:407] Connection header received
0809 07:58:35.573318 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.573321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.573389 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.573470 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.574899 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575701 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577092 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.577309 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577365 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.580558 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.580562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.580564 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.580592 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.583152 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.583714 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.583718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.583720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.583824 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584243 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.584247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.584249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.584482 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.584570 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.585441 (+ 871us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.585608 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 07:58:35.586198 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.572666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:59853 (local address 127.8.51.124:40895)
0809 07:58:35.572810 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.572814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.573566 (+ 752us) server_negotiation.cc:407] Connection header received
0809 07:58:35.573690 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.573693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.573749 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.573839 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.574898 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575704 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577074 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.577424 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577562 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.581015 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.581019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.581022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.581052 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.582881 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.583920 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.583923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.583925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.584010 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584297 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.584300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.584302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.584527 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.584612 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.585916 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.586045 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:58:35.587030 16309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.571618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.8.51.67:38739)
0809 07:58:35.572101 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.572152 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.573102 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.573631 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.573637 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.574199 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.574751 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.574756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575855 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.575858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.576952 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.576962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.577541 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.577720 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.578342 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.578362 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.580391 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.583287 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.583291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.583294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.583596 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.583940 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.583945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.583950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.584133 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.584624 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.584631 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.584989 (+ 358us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.585184 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.586599 (+ 1415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":1326,"spinlock_wait_cycles":28544,"thread_start_us":144,"threads_started":1}
I20260809 07:58:35.587337 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.572533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.8.51.67:59853)
0809 07:58:35.573483 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.573496 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.573609 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.573880 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.573883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.574237 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.574746 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.574755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575855 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.575858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.576955 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.576962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.577596 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.577601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.578060 (+ 459us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.579005 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.579017 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.580851 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.583021 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.583028 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.583049 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.583808 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.584105 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.584110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.584205 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.584667 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.584671 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.584990 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.585183 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.585535 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"mutex_wait_us":492,"spinlock_wait_cycles":9856,"thread_start_us":129,"threads_started":1}
I20260809 07:58:35.587502 16311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.571618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:48387)
0809 07:58:35.572839 (+ 1221us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.572852 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.573111 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.573620 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.573628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.574181 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:35.574733 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.574747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575534 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.575537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.576399 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.576408 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.576915 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.576919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.577173 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.577850 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:35.577866 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:35.580910 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:35.584162 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.584173 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.584415 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.584725 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:35.584730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:35.584815 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:35.585262 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:35.585264 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:35.585366 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.585467 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.585610 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1139,"mutex_wait_us":95,"spinlock_wait_cycles":56448,"thread_start_us":124,"threads_started":1}
I20260809 07:58:35.588066 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.571147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:48387 (local address 127.8.51.126:36079)
0809 07:58:35.571273 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.571278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.572954 (+ 1676us) server_negotiation.cc:407] Connection header received
0809 07:58:35.573296 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.573299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.573355 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.573433 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.574873 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.575397 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.576533 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.576770 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.576881 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.581077 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.581080 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.581082 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.581108 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.584048 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584534 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.584540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.584544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.584629 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.584922 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.584926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.584927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.585120 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.585210 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.587774 (+ 2564us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.587919 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 07:58:35.588768 16305 heartbeater.cc:347] Connected to a master server at 127.8.51.126:36079
I20260809 07:58:35.588807 16307 heartbeater.cc:347] Connected to a master server at 127.8.51.125:37403
I20260809 07:58:35.589007 16307 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.589010 16305 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.589445 16304 heartbeater.cc:347] Connected to a master server at 127.8.51.124:40895
I20260809 07:58:35.589524 16304 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:35.589620 16305 heartbeater.cc:511] Master 127.8.51.126:36079 requested a full tablet report, sending...
I20260809 07:58:35.589867 16304 heartbeater.cc:511] Master 127.8.51.124:40895 requested a full tablet report, sending...
I20260809 07:58:35.590433 16307 heartbeater.cc:511] Master 127.8.51.125:37403 requested a full tablet report, sending...
I20260809 07:58:35.590795 15817 ts_manager.cc:194] Registered new tserver with Master: f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:35.591171 15618 ts_manager.cc:194] Registered new tserver with Master: f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:35.591230 14978 ts_manager.cc:194] Re-registered known tserver with Master: f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:35.591801 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.581261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53400 (local address 127.8.51.126:36079)
0809 07:58:35.581540 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.581545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.582334 (+ 789us) server_negotiation.cc:407] Connection header received
0809 07:58:35.582380 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.582383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.582430 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.582510 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.583599 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.584368 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.585517 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.585864 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.585960 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.587623 (+ 1663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.587626 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.587628 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.587653 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.589417 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.589947 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.589950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.589952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.590037 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.590544 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.590547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.590548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.590747 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.590877 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.591498 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.591636 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
I20260809 07:58:35.591974 14978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:48387
I20260809 07:58:35.594823 14978 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:35.598747 14978 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:35.599231 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.583459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39074 (local address 127.8.51.124:40895)
0809 07:58:35.586383 (+ 2924us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.586389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.589051 (+ 2662us) server_negotiation.cc:407] Connection header received
0809 07:58:35.589228 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.589231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.589286 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.589335 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.590174 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.590861 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.592841 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.593142 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.593216 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.594876 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.594880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.594882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.594905 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.596535 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.597031 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.597034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.597036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.597146 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.597476 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.597479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.597481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.597729 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.597890 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.598949 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.599060 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2849,"thread_start_us":109,"threads_started":1}
I20260809 07:58:35.601818 15785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: NON_VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: true } } }
I20260809 07:58:35.601948 15785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:35.602739 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.581787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37952 (local address 127.8.51.125:37403)
0809 07:58:35.585929 (+ 4142us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.585933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.591626 (+ 5693us) server_negotiation.cc:407] Connection header received
0809 07:58:35.591669 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.591674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.591723 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.591806 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.594497 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.595250 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.596560 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.596874 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.596981 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.598732 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.598735 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.598738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.598765 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.600462 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.600967 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.600969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.600970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.601043 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.601349 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.601352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.601353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.601564 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.601721 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.602476 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.602592 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4086,"thread_start_us":76,"threads_started":1}
I20260809 07:58:35.605185 16325 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: attempting to promote NON_VOTER 5879958135eb4f75866b1b5d964f48e5 to VOTER
I20260809 07:58:35.605479 16325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } }
I20260809 07:58:35.606580 15630 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Refusing update from remote peer 8119b7326f3e47fd902d890bf112b99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 07:58:35.606608 15828 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 LEARNER]: Refusing update from remote peer 8119b7326f3e47fd902d890bf112b99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 07:58:35.606967 16326 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 07:58:35.607189 15785 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 07:58:35.608819 15785 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610352 15785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610452 15785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:35.610067 15828 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610322 15630 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610565 15785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610666 15785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:35.610769 15785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.610844 15785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:35.611788 15859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.611914 15859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:35.611912 16334 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8119b7326f3e47fd902d890bf112b99d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:35.612051 16334 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:35.621803 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.616368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:46611 (local address 127.0.0.1:37920)
0809 07:58:35.616535 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.616552 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.616635 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.618232 (+ 1597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.618235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.618253 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.618358 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.618364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.619462 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.619469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.620432 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.620441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.621349 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.621353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.621478 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.621500 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.621566 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.621667 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":31}
I20260809 07:58:35.621978 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.616566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37920 (local address 127.8.51.66:46611)
0809 07:58:35.617474 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.617486 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.617510 (+ 24us) server_negotiation.cc:407] Connection header received
0809 07:58:35.617709 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.617716 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.618092 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.618272 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.618458 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.619360 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.620583 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.621210 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.621468 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.621674 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.621726 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.621833 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":245,"threads_started":1}
I20260809 07:58:35.622977 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.617288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:35919 (local address 127.0.0.1:32850)
0809 07:58:35.618082 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.618095 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.618179 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.618873 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.618876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.618894 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.618990 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.618996 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.620243 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.620246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.621651 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.621668 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.622631 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.622635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.622739 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.622765 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.622804 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.622853 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"mutex_wait_us":269,"thread_start_us":92,"threads_started":1}
I20260809 07:58:35.622984 16338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.616879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:40323 (local address 127.0.0.1:59528)
0809 07:58:35.617515 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.617530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.617802 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.618499 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.618502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.618517 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.618607 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.618612 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.620026 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.620029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.621301 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.621311 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.622559 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.622565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.622661 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.622686 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.622758 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.622833 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":45,"thread_start_us":101,"threads_started":1}
I20260809 07:58:35.623617 16339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.617447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.8.51.65:35919)
0809 07:58:35.618414 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.618430 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.618453 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:58:35.618527 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.618531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.618729 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.618876 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.619084 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.620123 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.621784 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.622508 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.623291 (+ 783us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.623386 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.623443 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.623511 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":867,"thread_start_us":69,"threads_started":1}
I20260809 07:58:35.624035 16337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.617010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59528 (local address 127.8.51.67:40323)
0809 07:58:35.617330 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.617351 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.617720 (+ 369us) server_negotiation.cc:407] Connection header received
0809 07:58:35.617955 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.617961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.618192 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.618346 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.618741 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.619867 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.621443 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.622247 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.622326 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.622454 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.622816 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.622916 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":100,"threads_started":1}
I20260809 07:58:35.625347 16083 tablet_service.cc:1467] Processing CreateTablet for tablet 15f856b74d99421ebab5de3d383d3005 (DEFAULT_TABLE table=test-table [id=5ea670a5af204e26bd613d02f22fe679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:35.626423 16083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f856b74d99421ebab5de3d383d3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:35.626300 15937 tablet_service.cc:1467] Processing CreateTablet for tablet 15f856b74d99421ebab5de3d383d3005 (DEFAULT_TABLE table=test-table [id=5ea670a5af204e26bd613d02f22fe679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:35.626624 16235 tablet_service.cc:1467] Processing CreateTablet for tablet 15f856b74d99421ebab5de3d383d3005 (DEFAULT_TABLE table=test-table [id=5ea670a5af204e26bd613d02f22fe679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:35.627377 15937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f856b74d99421ebab5de3d383d3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:35.627501 16235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f856b74d99421ebab5de3d383d3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:35.633594 16340 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Bootstrap starting.
I20260809 07:58:35.635318 16341 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Bootstrap starting.
I20260809 07:58:35.636174 16342 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Bootstrap starting.
I20260809 07:58:35.636672 16340 tablet_bootstrap.cc:654] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:35.637490 16341 tablet_bootstrap.cc:654] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:35.637753 16340 log.cc:824] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:35.638017 16342 tablet_bootstrap.cc:654] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:35.638363 16341 log.cc:824] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:35.638841 16342 log.cc:824] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:35.640286 16340 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: No bootstrap required, opened a new log
I20260809 07:58:35.640281 16341 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: No bootstrap required, opened a new log
I20260809 07:58:35.640473 16341 ts_tablet_manager.cc:1397] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:35.640473 16340 ts_tablet_manager.cc:1397] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 07:58:35.642951 16342 tablet_bootstrap.cc:492] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: No bootstrap required, opened a new log
I20260809 07:58:35.643167 16342 ts_tablet_manager.cc:1397] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 07:58:35.644531 16341 raft_consensus.cc:348] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.644832 16341 raft_consensus.cc:374] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:35.644882 16341 raft_consensus.cc:729] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1f4866b414f4baab81a9aefa4326b5f, State: Initialized, Role: FOLLOWER
I20260809 07:58:35.645253 16340 raft_consensus.cc:348] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.645376 16341 consensus_queue.cc:260] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.645507 16340 raft_consensus.cc:374] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:35.645561 16340 raft_consensus.cc:729] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b9d71a26a047279fbce739a3cca873, State: Initialized, Role: FOLLOWER
I20260809 07:58:35.646019 16009 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
I20260809 07:58:35.646047 16340 consensus_queue.cc:260] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.647136 16155 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
I20260809 07:58:35.647874 16340 ts_tablet_manager.cc:1428] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260809 07:58:35.648360 16342 raft_consensus.cc:348] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.648589 16342 raft_consensus.cc:374] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:35.648643 16342 raft_consensus.cc:729] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f592223a687d4ae5be44bd518655fc2c, State: Initialized, Role: FOLLOWER
I20260809 07:58:35.649066 16342 consensus_queue.cc:260] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.650079 16342 ts_tablet_manager.cc:1428] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 07:58:35.650441 16305 heartbeater.cc:503] Master 127.8.51.126:36079 was elected leader, sending a full tablet report...
I20260809 07:58:35.652017 16341 ts_tablet_manager.cc:1428] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
W20260809 07:58:35.821216 16308 tablet.cc:2369] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:35.822075 16346 raft_consensus.cc:482] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:35.822296 16346 raft_consensus.cc:504] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.823474 16346 leader_election.cc:288] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611), f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:35.827404 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.823867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:33223 (local address 127.8.51.66:46611)
0809 07:58:35.824008 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.824015 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.824186 (+ 171us) server_negotiation.cc:407] Connection header received
0809 07:58:35.824356 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.824358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.824403 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.824490 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.824770 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.825274 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.826459 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.826856 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.826975 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.827038 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.827211 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.827281 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:35.827409 16350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.823752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:46611 (local address 127.8.51.65:33223)
0809 07:58:35.824051 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.824068 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.824203 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.824506 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.824509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.824527 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.824639 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.824644 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.825418 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.825423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.826326 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.826335 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.826983 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.826987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.827070 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.827093 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.827196 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.827269 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":101,"threads_started":1}
I20260809 07:58:35.827529 16337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.823910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:60989 (local address 127.8.51.67:40323)
0809 07:58:35.824052 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.824058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.824432 (+ 374us) server_negotiation.cc:407] Connection header received
0809 07:58:35.824585 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.824588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.824641 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.824738 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:35.824972 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.825492 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.826550 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.826949 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.827066 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.827129 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.827330 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.827399 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 07:58:35.827718 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.823759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:40323 (local address 127.8.51.65:60989)
0809 07:58:35.824332 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:35.824343 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:35.824469 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:35.824752 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:35.824754 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:35.824770 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:35.824864 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.824870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.825632 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.825635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.826411 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:35.826419 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.827082 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.827085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:35.827191 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.827215 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 07:58:35.827312 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 07:58:35.827384 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":282,"thread_start_us":117,"threads_started":1}
I20260809 07:58:35.828102 16103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f856b74d99421ebab5de3d383d3005" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b9d71a26a047279fbce739a3cca873" is_pre_election: true
I20260809 07:58:35.828365 16257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f856b74d99421ebab5de3d383d3005" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f592223a687d4ae5be44bd518655fc2c" is_pre_election: true
I20260809 07:58:35.828445 16103 raft_consensus.cc:2454] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 0.
I20260809 07:58:35.828647 16257 raft_consensus.cc:2454] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 0.
I20260809 07:58:35.828984 15888 leader_election.cc:302] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7b9d71a26a047279fbce739a3cca873, e1f4866b414f4baab81a9aefa4326b5f; no voters:
I20260809 07:58:35.829278 16346 raft_consensus.cc:2781] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:35.829360 16346 raft_consensus.cc:482] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:35.829391 16346 raft_consensus.cc:3037] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:35.830475 16346 raft_consensus.cc:504] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.830830 16346 leader_election.cc:288] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 election: Requested vote from peers d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611), f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323)
I20260809 07:58:35.831187 16257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f856b74d99421ebab5de3d383d3005" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f592223a687d4ae5be44bd518655fc2c"
I20260809 07:58:35.831189 16103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f856b74d99421ebab5de3d383d3005" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b9d71a26a047279fbce739a3cca873"
I20260809 07:58:35.831318 16257 raft_consensus.cc:3037] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:35.831331 16103 raft_consensus.cc:3037] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:35.832377 16257 raft_consensus.cc:2454] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 1.
I20260809 07:58:35.832456 16103 raft_consensus.cc:2454] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 1.
I20260809 07:58:35.832727 15887 leader_election.cc:302] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1f4866b414f4baab81a9aefa4326b5f, f592223a687d4ae5be44bd518655fc2c; no voters:
I20260809 07:58:35.832957 16346 raft_consensus.cc:2781] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:35.833206 16346 raft_consensus.cc:686] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 1 LEADER]: Becoming Leader. State: Replica: e1f4866b414f4baab81a9aefa4326b5f, State: Running, Role: LEADER
I20260809 07:58:35.833587 16346 consensus_queue.cc:237] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } }
I20260809 07:58:35.837448 14977 catalog_manager.cc:5495] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f reported cstate change: term changed from 0 to 1, leader changed from <none> to e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65). New cstate: current_term: 1 leader_uuid: "e1f4866b414f4baab81a9aefa4326b5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } health_report { overall_health: HEALTHY } } }
W20260809 07:58:35.839973 16157 tablet.cc:2369] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:35.855311 16339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.852105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32864 (local address 127.8.51.65:35919)
0809 07:58:35.852233 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.852237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.852249 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:35.852321 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.852323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.852373 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.852457 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:35.852676 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.853155 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.854010 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.854215 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.854291 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.854543 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:35.854944 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:35.855033 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.855088 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.855137 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 07:58:35.861265 16103 raft_consensus.cc:1261] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Refusing update from remote peer e1f4866b414f4baab81a9aefa4326b5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:35.861266 16257 raft_consensus.cc:1261] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Refusing update from remote peer e1f4866b414f4baab81a9aefa4326b5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:35.862062 16346 consensus_queue.cc:1035] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:35.862282 16352 consensus_queue.cc:1035] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:35.874686 16356 mvcc.cc:205] Tried to move back new op lower bound from 7316530445760548864 to 7316530445658300416. Current Snapshot: MvccSnapshot[applied={T|T < 7316530445760548864}]
I20260809 07:58:35.874782 16357 mvcc.cc:205] Tried to move back new op lower bound from 7316530445760548864 to 7316530445658300416. Current Snapshot: MvccSnapshot[applied={T|T < 7316530445760548864}]
I20260809 07:58:35.881518 14977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:35.881713 14977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:35.885442 14977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8119b7326f3e47fd902d890bf112b99d: Sending DeleteTablet for 3 replicas of tablet 15f856b74d99421ebab5de3d383d3005
I20260809 07:58:35.886231 16235 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f856b74d99421ebab5de3d383d3005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:35 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:59528
I20260809 07:58:35.886241 16083 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f856b74d99421ebab5de3d383d3005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:35 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:37920
I20260809 07:58:35.886721 16366 tablet_replica.cc:330] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: stopping tablet replica
I20260809 07:58:35.887017 16366 raft_consensus.cc:2229] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:35.886997 15937 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f856b74d99421ebab5de3d383d3005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:35 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:32850
I20260809 07:58:35.887423 16366 raft_consensus.cc:2258] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:35.887490 16365 tablet_replica.cc:330] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: stopping tablet replica
I20260809 07:58:35.888016 16365 raft_consensus.cc:2229] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:35.888352 16365 raft_consensus.cc:2258] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:35.889065 16366 ts_tablet_manager.cc:1905] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:35.890309 16365 ts_tablet_manager.cc:1905] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:35.890715 16367 tablet_replica.cc:330] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: stopping tablet replica
I20260809 07:58:35.891268 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 14944
I20260809 07:58:35.894728 16366 ts_tablet_manager.cc:1918] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:35.894840 16366 log.cc:1196] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/15f856b74d99421ebab5de3d383d3005
I20260809 07:58:35.895373 16366 ts_tablet_manager.cc:1939] T 15f856b74d99421ebab5de3d383d3005 P f592223a687d4ae5be44bd518655fc2c: Deleting consensus metadata
I20260809 07:58:35.895985 16365 ts_tablet_manager.cc:1918] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:35.896152 16365 log.cc:1196] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/15f856b74d99421ebab5de3d383d3005
I20260809 07:58:35.896615 16365 ts_tablet_manager.cc:1939] T 15f856b74d99421ebab5de3d383d3005 P d7b9d71a26a047279fbce739a3cca873: Deleting consensus metadata
I20260809 07:58:35.897841 16367 raft_consensus.cc:2229] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:35.898252 16367 raft_consensus.cc:2258] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:35.899695 16367 ts_tablet_manager.cc:1905] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 07:58:35.902062 16178 connection.cc:535] server connection from 127.0.0.1:59528 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 07:58:35.902663 16036 connection.cc:535] server connection from 127.0.0.1:37920 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 07:58:35.903000 16367 ts_tablet_manager.cc:1918] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:35.903172 16367 log.cc:1196] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/15f856b74d99421ebab5de3d383d3005
I20260809 07:58:35.903621 16367 ts_tablet_manager.cc:1939] T 15f856b74d99421ebab5de3d383d3005 P e1f4866b414f4baab81a9aefa4326b5f: Deleting consensus metadata
W20260809 07:58:35.905684 15888 connection.cc:441] server connection from 127.0.0.1:32850 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32850 (request call id 1) could send its response
I20260809 07:58:35.910092 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.889830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37956 (local address 127.8.51.125:37403)
0809 07:58:35.889939 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.889944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.898683 (+ 8739us) server_negotiation.cc:407] Connection header received
0809 07:58:35.898932 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.898935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.898988 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.899039 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.900052 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.900854 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.902019 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.902342 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.902413 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.905391 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.905395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.905397 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.905425 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.907406 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.907880 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.907884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.907886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.907979 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.908288 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.908291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.908293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.908508 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.908637 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.909817 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.909936 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:58:35.918377 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.907214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39080 (local address 127.8.51.124:40895)
0809 07:58:35.907606 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.907611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.907837 (+ 226us) server_negotiation.cc:407] Connection header received
0809 07:58:35.908012 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.908018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.908068 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.908126 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.909058 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.909896 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.911753 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.912082 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.912164 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.914241 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.914247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.914255 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.914291 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.916232 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.916839 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.916845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.916847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.916949 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.917269 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.917275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.917278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.917538 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.918031 (+ 493us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.918103 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.918214 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298}
I20260809 07:58:35.918915 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.906736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.8.51.125:37403)
0809 07:58:35.906855 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.906858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.907350 (+ 492us) server_negotiation.cc:407] Connection header received
0809 07:58:35.907904 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.907908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.907965 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.908043 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.909055 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.909896 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.911472 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.911828 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.911891 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.913836 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.913842 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.913846 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.913877 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.916344 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.917319 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.917325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.917329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.917407 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.917769 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.917772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.917773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.918002 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.918102 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.918622 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.918778 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 07:58:35.920543 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:35.890712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39078 (local address 127.8.51.124:40895)
0809 07:58:35.890820 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:35.890825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:35.909476 (+ 18651us) server_negotiation.cc:407] Connection header received
0809 07:58:35.909527 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:35.909538 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:35.909608 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:35.909676 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:35.910987 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.911740 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.912910 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:35.913243 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:35.913325 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:35.914964 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:35.914968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:35.914971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:35.914997 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:35.917826 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.919088 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.919093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.919096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.919178 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:35.919488 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:35.919491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:35.919493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:35.919713 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:35.919820 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:35.920284 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 07:58:35.920390 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:58:36.874886 16378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:36.874332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:40697)
0809 07:58:36.874659 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:36.874744 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":82,"threads_started":1}
W20260809 07:58:36.875275 16155 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:36079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:36.878834 16379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:36.878421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:34195)
0809 07:58:36.878643 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:36.878716 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":74,"threads_started":1}
I20260809 07:58:36.879194 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:36.878702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:48787)
0809 07:58:36.879018 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:36.879102 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":83,"threads_started":1}
W20260809 07:58:36.879256 16305 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:36079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
W20260809 07:58:36.879643 16009 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:36079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.387300 16381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8119b7326f3e47fd902d890bf112b99d)
I20260809 07:58:37.387549 16381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } }
I20260809 07:58:37.388540 16381 leader_election.cc:288] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079), ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125:37403)
I20260809 07:58:37.388965 16383 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8119b7326f3e47fd902d890bf112b99d)
I20260809 07:58:37.389122 16382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.388632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53842)
0809 07:58:37.388913 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.389002 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":87,"threads_started":1}
W20260809 07:58:37.389343 15799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.389310 16383 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } }
I20260809 07:58:37.390098 16382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.389908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53858)
0809 07:58:37.390005 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.390051 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 07:58:37.390281 15799 leader_election.cc:334] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079): Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.390643 16383 leader_election.cc:288] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079), 5879958135eb4f75866b1b5d964f48e5 (127.8.51.124:40895)
I20260809 07:58:37.390863 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.390411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53864)
0809 07:58:37.390693 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.390761 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":64,"threads_started":1}
W20260809 07:58:37.391012 15602 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.391892 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.391667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53866)
0809 07:58:37.391773 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.391824 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 07:58:37.392002 15602 leader_election.cc:334] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079): Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.393007 16386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.388921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37966 (local address 127.8.51.125:37403)
0809 07:58:37.389193 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.389200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.389217 (+ 17us) server_negotiation.cc:407] Connection header received
0809 07:58:37.389271 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.389274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.389316 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.389409 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:37.389714 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.390436 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.392050 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.392493 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.392601 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.392656 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.392827 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.392892 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":64,"threads_started":1}
I20260809 07:58:37.393007 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.388769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:37403 (local address 127.0.0.1:37966)
0809 07:58:37.389053 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.389082 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:37.389180 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:37.389435 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:37.389439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:37.389461 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:37.389560 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.389566 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.390566 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.390569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.391853 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.391861 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.392611 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.392614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.392704 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.392725 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 07:58:37.392811 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 07:58:37.392874 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":54,"threads_started":1}
I20260809 07:58:37.393453 15630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5879958135eb4f75866b1b5d964f48e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ec8bb99bd9e14ee391c6292163010b84" is_pre_election: true
I20260809 07:58:37.393685 15630 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5879958135eb4f75866b1b5d964f48e5 in term 1.
I20260809 07:58:37.394049 15801 leader_election.cc:302] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5879958135eb4f75866b1b5d964f48e5, ec8bb99bd9e14ee391c6292163010b84; no voters: 8119b7326f3e47fd902d890bf112b99d
I20260809 07:58:37.394268 16381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 07:58:37.394335 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.390475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40895 (local address 127.0.0.1:39082)
0809 07:58:37.390824 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.390837 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:37.390916 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:37.391272 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:37.391275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:37.391292 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:37.391370 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.391375 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.392304 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.392309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.393036 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.393044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.393936 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.393939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.394028 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.394048 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 07:58:37.394141 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 07:58:37.394209 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":55,"threads_started":1}
I20260809 07:58:37.394373 16381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8119b7326f3e47fd902d890bf112b99d)
I20260809 07:58:37.394390 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.390657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.8.51.124:40895)
0809 07:58:37.391037 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.391048 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.391062 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:37.391102 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.391104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.391155 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.391250 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:37.391488 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.392180 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.393219 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.393832 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.393940 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.393992 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.394160 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.394227 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":148,"threads_started":1}
I20260809 07:58:37.394423 16381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 07:58:37.395439 16381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } }
I20260809 07:58:37.395789 16381 leader_election.cc:288] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 election: Requested vote from peers 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079), ec8bb99bd9e14ee391c6292163010b84 (127.8.51.125:37403)
I20260809 07:58:37.396080 15630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5879958135eb4f75866b1b5d964f48e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ec8bb99bd9e14ee391c6292163010b84"
I20260809 07:58:37.396184 15828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec8bb99bd9e14ee391c6292163010b84" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5879958135eb4f75866b1b5d964f48e5" is_pre_election: true
I20260809 07:58:37.396235 15630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 1 FOLLOWER]: Advancing to term 2
I20260809 07:58:37.396239 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.395865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53872)
0809 07:58:37.396098 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.396147 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260809 07:58:37.396410 15828 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8bb99bd9e14ee391c6292163010b84 in current term 2: Already voted for candidate 5879958135eb4f75866b1b5d964f48e5 in this term.
I20260809 07:58:37.396885 15604 leader_election.cc:302] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8bb99bd9e14ee391c6292163010b84; no voters: 5879958135eb4f75866b1b5d964f48e5, 8119b7326f3e47fd902d890bf112b99d
I20260809 07:58:37.397218 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.396919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53886)
0809 07:58:37.397050 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.397165 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 07:58:37.397330 15799 leader_election.cc:334] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079): Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
I20260809 07:58:37.397552 15630 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5879958135eb4f75866b1b5d964f48e5 in term 2.
I20260809 07:58:37.397692 16383 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 07:58:37.397881 15801 leader_election.cc:302] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5879958135eb4f75866b1b5d964f48e5, ec8bb99bd9e14ee391c6292163010b84; no voters: 8119b7326f3e47fd902d890bf112b99d
I20260809 07:58:37.398054 16381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 07:58:37.398267 16381 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [term 2 LEADER]: Becoming Leader. State: Replica: 5879958135eb4f75866b1b5d964f48e5, State: Running, Role: LEADER
I20260809 07:58:37.398537 16381 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } }
I20260809 07:58:37.399849 16394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5879958135eb4f75866b1b5d964f48e5. Latest consensus state: current_term: 2 leader_uuid: "5879958135eb4f75866b1b5d964f48e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:37.399955 16394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:37.400264 16396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:37.402340 16396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:37.402748 16396 catalog_manager.cc:1259] Loaded cluster ID: 757cf027b1594bd2b5f5d54ed01b0a95
I20260809 07:58:37.402815 16396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:37.403311 16396 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:37.403705 16396 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Loaded TSK: 0
I20260809 07:58:37.404436 16396 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:58:37.434844 15816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:37.438004 15816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:37.440896 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.440652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53898)
0809 07:58:37.440761 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.440812 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 07:58:37.441020 15630 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [term 2 FOLLOWER]: Refusing update from remote peer 5879958135eb4f75866b1b5d964f48e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 07:58:37.441608 16394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 07:58:37.441709 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.441429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.0.0.1:53912)
0809 07:58:37.441540 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.441652 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 07:58:37.441824 15799 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 -> Peer 8119b7326f3e47fd902d890bf112b99d (127.8.51.126:36079): Couldn't send request to peer 8119b7326f3e47fd902d890bf112b99d. Status: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 07:58:37.443049 16383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5879958135eb4f75866b1b5d964f48e5. Latest consensus state: current_term: 2 leader_uuid: "5879958135eb4f75866b1b5d964f48e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:37.443181 16383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:37.444326 16394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5879958135eb4f75866b1b5d964f48e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:37.444443 16394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:37.444870 16383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5879958135eb4f75866b1b5d964f48e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "8119b7326f3e47fd902d890bf112b99d" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36079 } } peers { permanent_uuid: "ec8bb99bd9e14ee391c6292163010b84" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 37403 } attrs { promote: false } } peers { permanent_uuid: "5879958135eb4f75866b1b5d964f48e5" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40895 } attrs { promote: false } } }
I20260809 07:58:37.445001 16383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bb99bd9e14ee391c6292163010b84 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 07:58:37.454447 16382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.450352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:40323 (local address 127.0.0.1:59536)
0809 07:58:37.450476 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.450492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:37.450573 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:37.451177 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:37.451183 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:37.451204 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:37.451299 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.451305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452356 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.452361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.453110 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.453118 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.454036 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.454039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.454144 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.454174 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 07:58:37.454218 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 07:58:37.454314 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":2}
I20260809 07:58:37.454682 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.450059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:35919 (local address 127.0.0.1:32876)
0809 07:58:37.450182 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.450198 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:37.450283 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:37.450992 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:37.450995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:37.451010 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:37.451126 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.451135 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452281 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.452284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.453397 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.453407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.454310 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.454314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.454390 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.454409 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 07:58:37.454446 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 07:58:37.454496 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 07:58:37.455060 16404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.450611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59536 (local address 127.8.51.67:40323)
0809 07:58:37.450897 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.450901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.450915 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:37.450969 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.450973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.451032 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.451411 (+ 379us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:37.451530 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452253 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.453237 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.453889 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.454733 (+ 844us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.454805 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.454846 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.454917 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260809 07:58:37.455165 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.450228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32876 (local address 127.8.51.65:35919)
0809 07:58:37.450726 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.450731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.450748 (+ 17us) server_negotiation.cc:407] Connection header received
0809 07:58:37.450806 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.450809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.450862 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.451249 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:37.451399 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452156 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.453544 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.454185 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.454872 (+ 687us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.454940 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.454972 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.455027 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":69,"threads_started":1}
I20260809 07:58:37.455560 16235 tablet_service.cc:1467] Processing CreateTablet for tablet c40f572fb03b431687b4f99cec016a6b (DEFAULT_TABLE table=test-table [id=7e625415dcb948e3b1989ad47c72bf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:37.455652 15937 tablet_service.cc:1467] Processing CreateTablet for tablet c40f572fb03b431687b4f99cec016a6b (DEFAULT_TABLE table=test-table [id=7e625415dcb948e3b1989ad47c72bf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:37.455857 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.451280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.8.51.66:46611)
0809 07:58:37.451531 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.451535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.451600 (+ 65us) server_negotiation.cc:407] Connection header received
0809 07:58:37.451742 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.451745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.451791 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.451877 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:37.452110 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452866 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.454303 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.455037 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.455156 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.455223 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.455613 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.455708 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260809 07:58:37.455873 16235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40f572fb03b431687b4f99cec016a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:37.455952 15937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40f572fb03b431687b4f99cec016a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:37.455899 16405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.450947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:46611 (local address 127.0.0.1:37928)
0809 07:58:37.451529 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.451542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:37.451631 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:37.451903 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:37.451906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:37.451923 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:37.452001 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.452006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.452995 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.452999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.454159 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:37.454171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.455376 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.455380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:37.455470 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.455492 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 07:58:37.455570 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 07:58:37.455634 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":78,"threads_started":1}
I20260809 07:58:37.456693 16083 tablet_service.cc:1467] Processing CreateTablet for tablet c40f572fb03b431687b4f99cec016a6b (DEFAULT_TABLE table=test-table [id=7e625415dcb948e3b1989ad47c72bf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:37.456954 16083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40f572fb03b431687b4f99cec016a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:37.458465 16407 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Bootstrap starting.
I20260809 07:58:37.458895 16408 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: Bootstrap starting.
I20260809 07:58:37.459309 16407 tablet_bootstrap.cc:654] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:37.459604 16409 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Bootstrap starting.
I20260809 07:58:37.459796 16408 tablet_bootstrap.cc:654] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:37.460582 16409 tablet_bootstrap.cc:654] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:37.460687 16407 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: No bootstrap required, opened a new log
I20260809 07:58:37.460789 16407 ts_tablet_manager.cc:1397] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:37.461193 16408 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: No bootstrap required, opened a new log
I20260809 07:58:37.461272 16408 ts_tablet_manager.cc:1397] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:37.461272 16407 raft_consensus.cc:348] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.461383 16407 raft_consensus.cc:374] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:37.461418 16407 raft_consensus.cc:729] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f592223a687d4ae5be44bd518655fc2c, State: Initialized, Role: FOLLOWER
I20260809 07:58:37.461547 16407 consensus_queue.cc:260] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.461790 16409 tablet_bootstrap.cc:492] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: No bootstrap required, opened a new log
I20260809 07:58:37.461753 16408 raft_consensus.cc:348] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.461854 16408 raft_consensus.cc:374] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:37.461872 16409 ts_tablet_manager.cc:1397] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:37.461889 16408 raft_consensus.cc:729] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1f4866b414f4baab81a9aefa4326b5f, State: Initialized, Role: FOLLOWER
I20260809 07:58:37.461933 16407 ts_tablet_manager.cc:1428] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260809 07:58:37.462277 16409 raft_consensus.cc:348] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.462391 16409 raft_consensus.cc:374] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:37.462357 16408 consensus_queue.cc:260] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.462428 16409 raft_consensus.cc:729] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b9d71a26a047279fbce739a3cca873, State: Initialized, Role: FOLLOWER
I20260809 07:58:37.462563 16409 consensus_queue.cc:260] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.462739 16408 ts_tablet_manager.cc:1428] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:37.462903 16409 ts_tablet_manager.cc:1428] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:37.462985 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.462543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:34475)
0809 07:58:37.462829 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.462893 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260809 07:58:37.464206 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.463122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:38883)
0809 07:58:37.464056 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.464112 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":868,"thread_start_us":113,"threads_started":1}
I20260809 07:58:37.464927 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.464734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:56089)
0809 07:58:37.464824 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.464867 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 07:58:37.465088 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.463371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:40909)
0809 07:58:37.464640 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.464698 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1187,"thread_start_us":91,"threads_started":1}
I20260809 07:58:37.466678 16304 heartbeater.cc:503] Master 127.8.51.124:40895 was elected leader, sending a full tablet report...
I20260809 07:58:37.466897 16008 heartbeater.cc:503] Master 127.8.51.124:40895 was elected leader, sending a full tablet report...
I20260809 07:58:37.467311 16154 heartbeater.cc:503] Master 127.8.51.124:40895 was elected leader, sending a full tablet report...
I20260809 07:58:37.468055 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.467727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:38491)
0809 07:58:37.467919 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.467982 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 07:58:37.469424 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.466728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:35581)
0809 07:58:37.469303 (+ 2575us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.469358 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2499}
I20260809 07:58:37.472291 16414 raft_consensus.cc:482] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:37.472378 16414 raft_consensus.cc:504] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.472673 16414 leader_election.cc:288] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323), d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:37.473033 16257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c40f572fb03b431687b4f99cec016a6b" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f592223a687d4ae5be44bd518655fc2c" is_pre_election: true
I20260809 07:58:37.473073 16103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c40f572fb03b431687b4f99cec016a6b" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b9d71a26a047279fbce739a3cca873" is_pre_election: true
I20260809 07:58:37.473162 16257 raft_consensus.cc:2454] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 0.
I20260809 07:58:37.473214 16103 raft_consensus.cc:2454] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 0.
I20260809 07:58:37.473487 15887 leader_election.cc:302] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1f4866b414f4baab81a9aefa4326b5f, f592223a687d4ae5be44bd518655fc2c; no voters:
I20260809 07:58:37.473773 16414 raft_consensus.cc:2781] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:37.473827 16414 raft_consensus.cc:482] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:37.473863 16414 raft_consensus.cc:3037] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:37.474958 16414 raft_consensus.cc:504] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.475298 16414 leader_election.cc:288] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 election: Requested vote from peers f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323), d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611)
I20260809 07:58:37.475615 16103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c40f572fb03b431687b4f99cec016a6b" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b9d71a26a047279fbce739a3cca873"
I20260809 07:58:37.475630 16257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c40f572fb03b431687b4f99cec016a6b" candidate_uuid: "e1f4866b414f4baab81a9aefa4326b5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f592223a687d4ae5be44bd518655fc2c"
I20260809 07:58:37.475749 16103 raft_consensus.cc:3037] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:37.475772 16257 raft_consensus.cc:3037] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:37.476617 16103 raft_consensus.cc:2454] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 1.
I20260809 07:58:37.476697 16257 raft_consensus.cc:2454] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1f4866b414f4baab81a9aefa4326b5f in term 1.
I20260809 07:58:37.477010 15887 leader_election.cc:302] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1f4866b414f4baab81a9aefa4326b5f, f592223a687d4ae5be44bd518655fc2c; no voters:
I20260809 07:58:37.477221 16414 raft_consensus.cc:2781] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:37.477434 16414 raft_consensus.cc:686] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 1 LEADER]: Becoming Leader. State: Replica: e1f4866b414f4baab81a9aefa4326b5f, State: Running, Role: LEADER
I20260809 07:58:37.477626 16414 consensus_queue.cc:237] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } }
I20260809 07:58:37.478251 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.477923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:43663)
0809 07:58:37.478108 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.478168 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 07:58:37.479360 15816 catalog_manager.cc:5495] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f reported cstate change: term changed from 0 to 1, leader changed from <none> to e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65). New cstate: current_term: 1 leader_uuid: "e1f4866b414f4baab81a9aefa4326b5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1f4866b414f4baab81a9aefa4326b5f" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 35919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:37.493824 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.491051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32892 (local address 127.8.51.65:35919)
0809 07:58:37.491181 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:37.491184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:37.491210 (+ 26us) server_negotiation.cc:407] Connection header received
0809 07:58:37.491339 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:37.491341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:37.491383 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:37.491444 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:37.491655 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.492135 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.492920 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:37.493130 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:37.493204 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:37.493411 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:37.493474 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:37.493526 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:37.493682 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 07:58:37.493730 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 07:58:37.495801 16103 raft_consensus.cc:1261] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Refusing update from remote peer e1f4866b414f4baab81a9aefa4326b5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:37.495896 16257 raft_consensus.cc:1261] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Refusing update from remote peer e1f4866b414f4baab81a9aefa4326b5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:37.496219 16414 consensus_queue.cc:1035] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b9d71a26a047279fbce739a3cca873" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 46611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:37.496356 16419 consensus_queue.cc:1035] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f592223a687d4ae5be44bd518655fc2c" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:37.499351 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.498210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:50379)
0809 07:58:37.499195 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.499275 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":905}
I20260809 07:58:37.500211 16423 mvcc.cc:205] Tried to move back new op lower bound from 7316530452458606592 to 7316530452389879808. Current Snapshot: MvccSnapshot[applied={T|T < 7316530452458606592}]
I20260809 07:58:37.500986 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.500704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:39357)
0809 07:58:37.500864 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.500916 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 07:58:37.501910 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.501670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.65:41575)
0809 07:58:37.501804 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.501853 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 07:58:37.503682 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.503424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.67:43849)
0809 07:58:37.503549 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.503614 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 07:58:37.504737 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.498674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:33463)
0809 07:58:37.504602 (+ 5928us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.504667 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5855}
I20260809 07:58:37.505666 16431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.505139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:36079 (local address 127.8.51.66:51235)
0809 07:58:37.505487 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.505545 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":90,"threads_started":1}
I20260809 07:58:37.507405 15815 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:37.507535 15815 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:37.511194 15815 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5879958135eb4f75866b1b5d964f48e5: Sending DeleteTablet for 3 replicas of tablet c40f572fb03b431687b4f99cec016a6b
I20260809 07:58:37.511801 15937 tablet_service.cc:1514] Processing DeleteTablet for tablet c40f572fb03b431687b4f99cec016a6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:37 UTC) from {username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:32876
I20260809 07:58:37.511940 16083 tablet_service.cc:1514] Processing DeleteTablet for tablet c40f572fb03b431687b4f99cec016a6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:37 UTC) from {username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:37928
I20260809 07:58:37.512135 16235 tablet_service.cc:1514] Processing DeleteTablet for tablet c40f572fb03b431687b4f99cec016a6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:37 UTC) from {username='oryx', principal='oryx/127.8.51.124@KRBTEST.COM'} at 127.0.0.1:59536
I20260809 07:58:37.512347 16434 tablet_replica.cc:330] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: stopping tablet replica
I20260809 07:58:37.512506 16433 tablet_replica.cc:330] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f: stopping tablet replica
I20260809 07:58:37.512516 16434 raft_consensus.cc:2229] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:37.512631 16433 raft_consensus.cc:2229] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:37.512677 16435 tablet_replica.cc:330] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: stopping tablet replica
I20260809 07:58:37.512789 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15774
I20260809 07:58:37.512810 16433 raft_consensus.cc:2258] T c40f572fb03b431687b4f99cec016a6b P e1f4866b414f4baab81a9aefa4326b5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:37.512833 16434 raft_consensus.cc:2258] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:37.512811 16435 raft_consensus.cc:2229] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:37.513880 16435 raft_consensus.cc:2258] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:37.516387 16435 ts_tablet_manager.cc:1905] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:37.518606 16434 ts_tablet_manager.cc:1905] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:37.520251 16435 ts_tablet_manager.cc:1918] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:37.520337 16435 log.cc:1196] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/c40f572fb03b431687b4f99cec016a6b
I20260809 07:58:37.520619 16435 ts_tablet_manager.cc:1939] T c40f572fb03b431687b4f99cec016a6b P f592223a687d4ae5be44bd518655fc2c: Deleting consensus metadata
I20260809 07:58:37.521482 16434 ts_tablet_manager.cc:1918] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:37.521469 15800 catalog_manager.cc:4841] TS f592223a687d4ae5be44bd518655fc2c (127.8.51.67:40323): tablet c40f572fb03b431687b4f99cec016a6b (table test-table [id=7e625415dcb948e3b1989ad47c72bf81]) successfully deleted
I20260809 07:58:37.521582 16434 log.cc:1196] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/c40f572fb03b431687b4f99cec016a6b
I20260809 07:58:37.522032 16434 ts_tablet_manager.cc:1939] T c40f572fb03b431687b4f99cec016a6b P d7b9d71a26a047279fbce739a3cca873: Deleting consensus metadata
I20260809 07:58:37.522677 15801 catalog_manager.cc:4841] TS d7b9d71a26a047279fbce739a3cca873 (127.8.51.66:46611): tablet c40f572fb03b431687b4f99cec016a6b (table test-table [id=7e625415dcb948e3b1989ad47c72bf81]) successfully deleted
I20260809 07:58:37.527217 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16016
I20260809 07:58:37.527386 16405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:37.527076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:35919 (local address 127.0.0.1:32898)
0809 07:58:37.527223 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:37.527288 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:35919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 07:58:37.528450 15801 catalog_manager.cc:4584] TS e1f4866b414f4baab81a9aefa4326b5f (127.8.51.65:35919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c40f572fb03b431687b4f99cec016a6b: Network error: Client connection negotiation failed: client connection to 127.8.51.65:35919: connect: Connection refused (error 111)
I20260809 07:58:37.534344 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16161
I20260809 07:58:37.540952 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15473
I20260809 07:58:37.547928 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 15590
2026-08-09T07:58:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5339 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:37 dist-test-slave-njxd krb5kdc[16438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:37 dist-test-slave-njxd krb5kdc[16438](info): set up 2 sockets
Aug 09 07:58:37 dist-test-slave-njxd krb5kdc[16438](info): commencing operation
krb5kdc: starting...
W20260809 07:58:38.593338 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:38 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab.
Entry for principal oryx/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab.
I20260809 07:58:38.718741 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45585
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab
--principal=oryx/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:38.830193 16451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:38.830456 16451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:38.830528 16451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:38.834617 16451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:38.834671 16451 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 07:58:38.834687 16451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:38.834739 16451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:38.834765 16451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:38.834797 16451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:38.840062 16451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45585
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.126.keytab
--principal=oryx/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:38.841089 16451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:38.842139 16451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:38.850404 16459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:38.850430 16457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:38.850441 16456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:38.850656 16451 server_base.cc:1034] running on GCE node
I20260809 07:58:38.851285 16451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:38.852347 16451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:38.853533 16451 hybrid_clock.cc:648] HybridClock initialized: now 1786262318853522 us; error 36 us; skew 500 ppm
Aug 09 07:58:38 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262318, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:38.856266 16451 init.cc:377] Logged in from keytab as oryx/127.8.51.126@KRBTEST.COM (short username oryx)
I20260809 07:58:38.857116 16451 webserver.cc:460] Webserver started at http://127.8.51.126:37599/ using document root <none> and password file <none>
I20260809 07:58:38.857717 16451 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:38.857808 16451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:38.858037 16451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:38.860018 16451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "fe24fc8e98dc4d8c982c20d2a2917521"
format_stamp: "Formatted at 2026-08-09 07:58:38 on dist-test-slave-njxd"
server_key: "b47513450fdd2ab3f5e88ca07301b030"
server_key_iv: "22f477304d1c4613057b7a32d8575506"
server_key_version: "encryptionkey@0"
I20260809 07:58:38.860574 16451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "fe24fc8e98dc4d8c982c20d2a2917521"
format_stamp: "Formatted at 2026-08-09 07:58:38 on dist-test-slave-njxd"
server_key: "b47513450fdd2ab3f5e88ca07301b030"
server_key_iv: "22f477304d1c4613057b7a32d8575506"
server_key_version: "encryptionkey@0"
I20260809 07:58:38.864077 16451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:38.866429 16467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:38.867543 16451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:38.867707 16451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "fe24fc8e98dc4d8c982c20d2a2917521"
format_stamp: "Formatted at 2026-08-09 07:58:38 on dist-test-slave-njxd"
server_key: "b47513450fdd2ab3f5e88ca07301b030"
server_key_iv: "22f477304d1c4613057b7a32d8575506"
server_key_version: "encryptionkey@0"
I20260809 07:58:38.867811 16451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:38.888345 16451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:38.891144 16451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:38.891350 16451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:38.899232 16451 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45585
I20260809 07:58:38.899259 16535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45585 every 8 connection(s)
I20260809 07:58:38.900156 16451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:38.903069 16536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:38.905542 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16451
I20260809 07:58:38.905720 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:38.906010 8397 external_mini_cluster.cc:1428] Setting key 9e5f396f25f70099dfc2a68a592b9a1a
I20260809 07:58:38.908877 16536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Bootstrap starting.
I20260809 07:58:38.911274 16536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:38.912040 16536 log.cc:824] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:38.914111 16536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: No bootstrap required, opened a new log
Aug 09 07:58:38 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:38.917877 16536 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } }
I20260809 07:58:38.918089 16536 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:38.918213 16536 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe24fc8e98dc4d8c982c20d2a2917521, State: Initialized, Role: FOLLOWER
I20260809 07:58:38.918697 16536 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } }
I20260809 07:58:38.918851 16536 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:38.918936 16536 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:38.919045 16536 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:38.920140 16536 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } }
I20260809 07:58:38.920415 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:38.907377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.8.51.126:45585)
0809 07:58:38.907769 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:38.907783 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:38.907816 (+ 33us) server_negotiation.cc:407] Connection header received
0809 07:58:38.908379 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:38.908394 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:38.908705 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:38.909046 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:38.909909 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:38.910933 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:38.911887 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:38.912415 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:38.912605 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:38.915445 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:38.915450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:38.915463 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:38.915490 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:38.917131 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:38.917639 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:38.917644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:38.917649 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:38.917758 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:38.918041 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:38.918045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:38.918047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:38.918559 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:38.918769 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:38.919139 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 07:58:38.919440 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":124,"threads_started":1}
I20260809 07:58:38.920480 16536 leader_election.cc:302] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe24fc8e98dc4d8c982c20d2a2917521; no voters:
I20260809 07:58:38.920794 16536 leader_election.cc:288] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:38.920931 16542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:38.921191 16542 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [term 1 LEADER]: Becoming Leader. State: Replica: fe24fc8e98dc4d8c982c20d2a2917521, State: Running, Role: LEADER
I20260809 07:58:38.921490 16542 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } }
I20260809 07:58:38.922052 16536 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:38.923103 16543 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } } }
I20260809 07:58:38.923221 16543 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:38.923602 16544 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe24fc8e98dc4d8c982c20d2a2917521. Latest consensus state: current_term: 1 leader_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe24fc8e98dc4d8c982c20d2a2917521" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45585 } } }
I20260809 07:58:38.923717 16544 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521 [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:38.924014 16551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:38.927176 16551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:38.932592 16551 catalog_manager.cc:1347] Generated new cluster ID: b966d46083a14110a9cb56863c702bc0
I20260809 07:58:38.932670 16551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:38.955381 16551 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:38.956617 16551 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:38.961422 16551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Generated new TSK 0
I20260809 07:58:38.962203 16551 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
I20260809 07:58:38.990605 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45585
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:39.138513 16564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:39.138760 16564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:39.138804 16564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:39.142635 16564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:39.142704 16564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:39.142782 16564 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:39.142839 16564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:39.147722 16564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:39.148752 16564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:39.149773 16564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:39.158833 16570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:39.158982 16564 server_base.cc:1034] running on GCE node
W20260809 07:58:39.158849 16569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:39.158838 16572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:39.159500 16564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:39.160092 16564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:39.161255 16564 hybrid_clock.cc:648] HybridClock initialized: now 1786262319161243 us; error 26 us; skew 500 ppm
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:39.164079 16564 init.cc:377] Logged in from keytab as oryx/127.8.51.65@KRBTEST.COM (short username oryx)
I20260809 07:58:39.164958 16564 webserver.cc:460] Webserver started at http://127.8.51.65:36709/ using document root <none> and password file <none>
I20260809 07:58:39.165506 16564 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:39.165565 16564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:39.165838 16564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:39.167738 16564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "e7d23bb376af0397a5cef82164d6e1a6"
server_key_iv: "47aff9571d2aa60154c18f26e1cdb80e"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.168251 16564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "e7d23bb376af0397a5cef82164d6e1a6"
server_key_iv: "47aff9571d2aa60154c18f26e1cdb80e"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.171653 16564 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 07:58:39.173885 16579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.174989 16564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:39.175127 16564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "e7d23bb376af0397a5cef82164d6e1a6"
server_key_iv: "47aff9571d2aa60154c18f26e1cdb80e"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.175235 16564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:39.207659 16564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:39.210567 16564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:39.210774 16564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:39.212244 16564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:39.212314 16564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.212386 16564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:39.212436 16564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:39.223243 16564 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:39747
I20260809 07:58:39.223304 16704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:39747 every 8 connection(s)
I20260809 07:58:39.224380 16564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:39.227010 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.213039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38011 (local address 127.8.51.126:45585)
0809 07:58:39.213221 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.213227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.214135 (+ 908us) server_negotiation.cc:407] Connection header received
0809 07:58:39.215486 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.215491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.215560 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.215712 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.216999 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.217913 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.219174 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.219617 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.219747 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.223386 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.223389 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.223392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.223418 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.225117 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.225740 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.225743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.225745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.225831 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.226121 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.226123 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.226124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.226298 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.226371 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.226791 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.226897 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 07:58:39.227795 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.213421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.65:38011)
0809 07:58:39.213952 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.214012 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.215168 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.215877 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.215884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.216251 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.216763 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.216777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.218049 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.218053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.219070 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.219080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.219793 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.219797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.219964 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.221175 (+ 1211us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.221201 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.223193 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.225232 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.225237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.225250 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.225492 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.225909 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.225911 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.225913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.226040 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.226384 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.226388 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.226595 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.226745 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.226979 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":155,"threads_started":1}
I20260809 07:58:39.228929 16705 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45585
I20260809 07:58:39.229054 16705 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:39.229553 16705 heartbeater.cc:511] Master 127.8.51.126:45585 requested a full tablet report, sending...
I20260809 07:58:39.231142 16484 ts_manager.cc:194] Registered new tserver with Master: 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747)
I20260809 07:58:39.232481 16484 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:38011
I20260809 07:58:39.234143 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16564
I20260809 07:58:39.234272 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:39.234915 8397 external_mini_cluster.cc:1428] Setting key cdf811995c8529bd8fe4d20b4efccb8c
I20260809 07:58:39.238240 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.231103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.65:50615)
0809 07:58:39.231375 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.231387 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.231489 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.231723 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.231725 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.231933 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.232046 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.232053 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.232810 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.232814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.233540 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.233550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.234043 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.234047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.234147 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.234662 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.234673 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.235015 (+ 342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.236883 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.236885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.236886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.237065 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.237365 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.237367 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.237369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.237441 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.237878 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.237880 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.237946 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.238021 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.238112 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":89,"threads_started":1}
I20260809 07:58:39.238430 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.231177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:50615 (local address 127.8.51.126:45585)
0809 07:58:39.231294 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.231299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.231453 (+ 154us) server_negotiation.cc:407] Connection header received
0809 07:58:39.231561 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.231564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.231603 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.231684 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.232159 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.232685 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.233693 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.233918 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.234027 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.235148 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.235152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.235155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.235183 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.236752 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.237165 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.237171 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.237176 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.237280 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.237529 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.237534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.237538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.237787 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.237886 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.238097 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.238225 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":41}
WARNING: no policy specified for oryx/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
I20260809 07:58:39.260347 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45585
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:39.365545 16714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:39.365787 16714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:39.365826 16714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:39.369693 16714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:39.369745 16714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:39.369781 16714 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:39.369812 16714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:39.374814 16714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:39.375705 16714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:39.376681 16714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:39.385694 16720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:39.385710 16719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:39.385825 16714 server_base.cc:1034] running on GCE node
W20260809 07:58:39.385744 16722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:39.386333 16714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:39.386874 16714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:39.388057 16714 hybrid_clock.cc:648] HybridClock initialized: now 1786262319388041 us; error 26 us; skew 500 ppm
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:39.390635 16714 init.cc:377] Logged in from keytab as oryx/127.8.51.66@KRBTEST.COM (short username oryx)
I20260809 07:58:39.391445 16714 webserver.cc:460] Webserver started at http://127.8.51.66:36685/ using document root <none> and password file <none>
I20260809 07:58:39.391968 16714 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:39.392057 16714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:39.392278 16714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:39.394292 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "0b424b563e46df9b1c182bf16f1328f0"
server_key_iv: "bf49d0396f6eb1c787cf0a0b9e9992ec"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.394855 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "0b424b563e46df9b1c182bf16f1328f0"
server_key_iv: "bf49d0396f6eb1c787cf0a0b9e9992ec"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.398276 16714 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 07:58:39.400456 16729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.401561 16714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:39.401732 16714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "0b424b563e46df9b1c182bf16f1328f0"
server_key_iv: "bf49d0396f6eb1c787cf0a0b9e9992ec"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.401849 16714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:39.420476 16714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:39.423722 16714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:39.423916 16714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:39.425328 16714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:39.425403 16714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.425467 16714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:39.425524 16714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:39.436630 16714 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:34767
I20260809 07:58:39.436709 16859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:34767 every 8 connection(s)
I20260809 07:58:39.437780 16714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:39.439533 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.426215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:40935 (local address 127.8.51.126:45585)
0809 07:58:39.426337 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.426341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.427378 (+ 1037us) server_negotiation.cc:407] Connection header received
0809 07:58:39.428369 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.428373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.428433 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.428493 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.430217 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.430838 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.432693 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.432998 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.433122 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.435826 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.435830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.435833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.435865 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.437591 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.438115 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.438119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.438120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.438234 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.438625 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.438634 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.438635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.438810 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.438889 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.439319 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.439417 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 07:58:39.440251 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.426750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.66:40935)
0809 07:58:39.427224 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.427265 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.428104 (+ 839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.428939 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.428963 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.429421 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.430059 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.430083 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.430969 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.430973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.432519 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.432536 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.433169 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.433174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.433399 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.434103 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.434118 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.435655 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.437703 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.437708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.437718 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.438013 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.438345 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.438351 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.438354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.438526 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.438907 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.438912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.439116 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.439269 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.439495 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":137,"threads_started":1}
I20260809 07:58:39.441516 16860 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45585
I20260809 07:58:39.441723 16860 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:39.442205 16860 heartbeater.cc:511] Master 127.8.51.126:45585 requested a full tablet report, sending...
I20260809 07:58:39.443178 16483 ts_manager.cc:194] Registered new tserver with Master: 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767)
I20260809 07:58:39.443944 16483 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:40935
I20260809 07:58:39.446267 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16714
I20260809 07:58:39.446379 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:39.446679 8397 external_mini_cluster.cc:1428] Setting key 2168617c146cf5b1363201db453902da
I20260809 07:58:39.450883 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.443558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.66:56381)
0809 07:58:39.443827 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.443839 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.443965 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.444260 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.444263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.444451 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.444541 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.444546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.445290 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.445294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.445917 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.445926 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.446499 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.446502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.446571 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.447053 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.447064 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.447426 (+ 362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.449106 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.449112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.449117 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.449382 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.449701 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.449707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.449711 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.449814 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.450488 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.450491 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.450578 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.450666 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.450765 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":102,"threads_started":1}
I20260809 07:58:39.451079 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.443628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:56381 (local address 127.8.51.126:45585)
0809 07:58:39.443743 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.443747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.443930 (+ 183us) server_negotiation.cc:407] Connection header received
0809 07:58:39.444090 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.444093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.444136 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.444232 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.444663 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.445168 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.446033 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.446352 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.446456 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.447541 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.447545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.447547 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.447567 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.448996 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.449474 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.449477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.449478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.449548 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.449905 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.449907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.449908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.450330 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.450483 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.450758 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.450887 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for oryx/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
I20260809 07:58:39.474785 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45585
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:39.586410 16869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:39.586771 16869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:39.586853 16869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:39.590720 16869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:39.590794 16869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:39.590862 16869 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 07:58:39.590936 16869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:39.596112 16869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.51.126:45585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:39.597154 16869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:39.598215 16869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:39.607597 16878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:39.607597 16874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:39.607709 16875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:39.607995 16869 server_base.cc:1034] running on GCE node
I20260809 07:58:39.608419 16869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:39.609054 16869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:39.610210 16869 hybrid_clock.cc:648] HybridClock initialized: now 1786262319610191 us; error 30 us; skew 500 ppm
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:39.612923 16869 init.cc:377] Logged in from keytab as oryx/127.8.51.67@KRBTEST.COM (short username oryx)
I20260809 07:58:39.613889 16869 webserver.cc:460] Webserver started at http://127.8.51.67:37779/ using document root <none> and password file <none>
I20260809 07:58:39.614414 16869 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:39.614475 16869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:39.614667 16869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:39.616782 16869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "374db79f9904466486e30ccf6cafc610"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "705c564e1ac09d071d996d5dc9d77bac"
server_key_iv: "5565579d6ac9eca457dcd648223a4561"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.617563 16869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "374db79f9904466486e30ccf6cafc610"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "705c564e1ac09d071d996d5dc9d77bac"
server_key_iv: "5565579d6ac9eca457dcd648223a4561"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.622088 16869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 07:58:39.625073 16885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.626719 16869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:39.626853 16869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "374db79f9904466486e30ccf6cafc610"
format_stamp: "Formatted at 2026-08-09 07:58:39 on dist-test-slave-njxd"
server_key: "705c564e1ac09d071d996d5dc9d77bac"
server_key_iv: "5565579d6ac9eca457dcd648223a4561"
server_key_version: "encryptionkey@0"
I20260809 07:58:39.626988 16869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:39.643702 16869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:39.647315 16869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:39.647506 16869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:39.648888 16869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:39.648974 16869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:39.649040 16869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:39.649088 16869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:39.659814 16869 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:46037
I20260809 07:58:39.659889 17007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:46037 every 8 connection(s)
I20260809 07:58:39.660993 16869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:39.661486 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 16869
I20260809 07:58:39.661649 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:39.661995 8397 external_mini_cluster.cc:1428] Setting key 5a767c6430eab72d37b34777e3fd5186
I20260809 07:58:39.664170 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.649786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:58207 (local address 127.8.51.126:45585)
0809 07:58:39.649941 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.649945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.651177 (+ 1232us) server_negotiation.cc:407] Connection header received
0809 07:58:39.652385 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.652389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.652449 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.652537 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.654260 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.655146 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.656962 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.657183 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.657266 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.660176 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.660181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.660183 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.660212 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.661974 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.662621 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.662628 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.662631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.662728 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.663086 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.663089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.663091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.663284 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.663359 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.663874 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.663996 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 07:58:39.664891 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.650524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.67:58207)
0809 07:58:39.651008 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.651057 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.652121 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.652892 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.652899 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.653349 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.654113 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.654136 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.655294 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.655299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.656830 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.656845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.657348 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.657352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.657611 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.658310 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.658332 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.659975 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.662118 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.662124 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.662137 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.662485 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.662812 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.662814 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.662816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.662950 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.663373 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.663383 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.663628 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.663783 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.664036 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":146,"threads_started":1}
I20260809 07:58:39.666141 17008 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45585
I20260809 07:58:39.666312 17008 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:39.666792 17008 heartbeater.cc:511] Master 127.8.51.126:45585 requested a full tablet report, sending...
I20260809 07:58:39.667775 16484 ts_manager.cc:194] Registered new tserver with Master: 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:39.668390 16484 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:58207
I20260809 07:58:39.675557 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.668451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:48381 (local address 127.8.51.126:45585)
0809 07:58:39.668586 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.668591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.668826 (+ 235us) server_negotiation.cc:407] Connection header received
0809 07:58:39.668937 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.668940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.668979 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.669074 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.669513 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.670075 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.671002 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.671238 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.671346 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.672475 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.672479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.672481 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.672505 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.673793 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.674202 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.674206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.674207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.674290 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.674625 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.674628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.674629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.674879 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.674974 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.675298 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.675411 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 07:58:39.675558 17014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.668375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.8.51.67:48381)
0809 07:58:39.668737 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.668750 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.668865 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.669087 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.669089 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.669309 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:39.669399 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.669405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.670203 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.670206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.670888 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.670897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.671349 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.671353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.671441 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.672009 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:39.672029 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:39.672339 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:39.673898 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.673902 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.673904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.674101 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.674381 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:39.674385 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:39.674387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:39.674498 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:39.674987 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:39.674990 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:39.675097 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.675217 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.675354 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":123,"threads_started":1}
I20260809 07:58:39.676205 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 07:58:39.699579 16540 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:39.694093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.8.51.126:45585)
0809 07:58:39.694233 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.694237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.694249 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:39.694288 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.694291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.694328 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.694394 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.695073 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.695575 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.696319 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.696503 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.696570 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.699453 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53338: BlockingRecv error: recv got EOF from 127.0.0.1:53338 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 07:58:39 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:39.708159 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.700852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53354 (local address 127.8.51.126:45585)
0809 07:58:39.700974 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.700977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.701031 (+ 54us) server_negotiation.cc:407] Connection header received
0809 07:58:39.701113 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.701115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.701145 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.701208 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:39.701799 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.702239 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.702946 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.703119 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.703190 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.705321 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:39.705324 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:39.705326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:39.705345 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:39.706551 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.706993 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.706998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.706999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.707069 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:39.707341 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:39.707344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:39.707346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:39.707512 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:39.707648 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.707895 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.708005 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:39.710850 16484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:39.713703 16484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:39.727728 17033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.721611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:34767 (local address 127.0.0.1:38920)
0809 07:58:39.722369 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.722420 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.722557 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.723587 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.723592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.723613 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:39.723781 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.723790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.725262 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.725267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.726343 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.726351 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.727158 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.727162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.727275 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.727316 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.727451 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.727581 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":68,"thread_start_us":74,"threads_started":1}
I20260809 07:58:39.727741 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.721761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.8.51.66:34767)
0809 07:58:39.723093 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.723107 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.723130 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:58:39.723231 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.723256 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.723439 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.723597 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:39.723883 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.725112 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.726476 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.727031 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.727157 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.727332 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.727481 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.727594 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1181,"thread_start_us":136,"threads_started":1}
I20260809 07:58:39.728641 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.722276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43306 (local address 127.8.51.67:46037)
0809 07:58:39.723218 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.723229 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.723249 (+ 20us) server_negotiation.cc:407] Connection header received
0809 07:58:39.723309 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.723313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.723452 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.723604 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:39.724115 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.724873 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.726456 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.727274 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.727376 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.727535 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.728380 (+ 845us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.728484 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":128,"threads_started":1}
I20260809 07:58:39.728121 17031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.721754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:46037 (local address 127.0.0.1:43306)
0809 07:58:39.722830 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.722841 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.722901 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.723759 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.723762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.723780 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:39.723946 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.723952 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.724995 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.725000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.726317 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.726328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.727601 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.727604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.727781 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.727810 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.727907 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.727989 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"mutex_wait_us":148,"spinlock_wait_cycles":4864,"thread_start_us":108,"threads_started":1}
I20260809 07:58:39.729738 17035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.722039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:39747 (local address 127.0.0.1:53242)
0809 07:58:39.723035 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.723048 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.723147 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.723759 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.723762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.723808 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:39.723945 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.723952 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.725287 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.725290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.727230 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.727243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.729283 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.729287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.729377 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.729400 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.729490 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.729595 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":943,"mutex_wait_us":867,"spinlock_wait_cycles":384,"thread_start_us":95,"threads_started":1}
I20260809 07:58:39.731009 16787 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce74a0133c5432fad70f80896c41e63 (DEFAULT_TABLE table=test-table [id=a436f90d56c34edda5ab41f698f8beff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.731590 16938 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce74a0133c5432fad70f80896c41e63 (DEFAULT_TABLE table=test-table [id=a436f90d56c34edda5ab41f698f8beff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.732167 16787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce74a0133c5432fad70f80896c41e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.732625 16938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce74a0133c5432fad70f80896c41e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.733796 17037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.722533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.8.51.65:39747)
0809 07:58:39.722835 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.722852 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.723139 (+ 287us) server_negotiation.cc:407] Connection header received
0809 07:58:39.723258 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.723264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.723453 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.723604 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:39.724069 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.725172 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.727388 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.728650 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.729081 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.729218 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.729537 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.733683 (+ 4146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":90,"threads_started":1}
I20260809 07:58:39.735854 16630 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce74a0133c5432fad70f80896c41e63 (DEFAULT_TABLE table=test-table [id=a436f90d56c34edda5ab41f698f8beff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.736639 16630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce74a0133c5432fad70f80896c41e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.740290 17039 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Bootstrap starting.
I20260809 07:58:39.741941 17038 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Bootstrap starting.
I20260809 07:58:39.742700 17039 tablet_bootstrap.cc:654] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.743553 17039 log.cc:824] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:39.743582 17040 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Bootstrap starting.
I20260809 07:58:39.744045 17038 tablet_bootstrap.cc:654] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.744753 17038 log.cc:824] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:39.745585 17040 tablet_bootstrap.cc:654] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.745669 17039 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: No bootstrap required, opened a new log
I20260809 07:58:39.745841 17039 ts_tablet_manager.cc:1397] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:58:39.746346 17040 log.cc:824] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:39.746459 17038 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: No bootstrap required, opened a new log
I20260809 07:58:39.746641 17038 ts_tablet_manager.cc:1397] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 07:58:39.748121 17040 tablet_bootstrap.cc:492] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: No bootstrap required, opened a new log
I20260809 07:58:39.748298 17040 ts_tablet_manager.cc:1397] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 07:58:39.749538 17039 raft_consensus.cc:348] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.749553 17038 raft_consensus.cc:348] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.749809 17039 raft_consensus.cc:374] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.749814 17038 raft_consensus.cc:374] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.749867 17039 raft_consensus.cc:729] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.749868 17038 raft_consensus.cc:729] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.750317 17038 consensus_queue.cc:260] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.750327 17039 consensus_queue.cc:260] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.750989 16860 heartbeater.cc:503] Master 127.8.51.126:45585 was elected leader, sending a full tablet report...
I20260809 07:58:39.751178 17008 heartbeater.cc:503] Master 127.8.51.126:45585 was elected leader, sending a full tablet report...
I20260809 07:58:39.751369 17038 ts_tablet_manager.cc:1428] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 07:58:39.752358 17039 ts_tablet_manager.cc:1428] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:58:39.752943 17040 raft_consensus.cc:348] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.753114 17040 raft_consensus.cc:374] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.753147 17040 raft_consensus.cc:729] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.753481 17040 consensus_queue.cc:260] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.754110 16705 heartbeater.cc:503] Master 127.8.51.126:45585 was elected leader, sending a full tablet report...
I20260809 07:58:39.754894 17040 ts_tablet_manager.cc:1428] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
W20260809 07:58:39.913231 17009 tablet.cc:2369] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:39.923990 17044 raft_consensus.cc:482] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:39.924216 17044 raft_consensus.cc:504] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.925395 17044 leader_election.cc:288] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037), 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747)
I20260809 07:58:39.930526 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.925648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:46037 (local address 127.8.51.66:37227)
0809 07:58:39.925841 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.925857 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.925954 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.926278 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.926281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.926302 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:39.926423 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.926431 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.927526 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.927532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.929173 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.929184 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.930104 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.930108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.930203 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.930223 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.930286 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.930345 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":66}
I20260809 07:58:39.930555 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.925754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:37227 (local address 127.8.51.67:46037)
0809 07:58:39.925873 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.925880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.925901 (+ 21us) server_negotiation.cc:407] Connection header received
0809 07:58:39.926086 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.926089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.926136 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.926247 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:39.926567 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.927400 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.929307 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.929935 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.930062 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.930129 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.930325 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.930400 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 07:58:39.931047 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.925705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:39747 (local address 127.8.51.66:44357)
0809 07:58:39.926090 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:39.926101 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:39.926184 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:39.926442 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:39.926445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:39.926463 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:39.926591 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.926596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.927555 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.927558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.929672 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:39.929681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.930581 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.930584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:39.930698 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.930734 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 07:58:39.930846 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 07:58:39.930923 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":73,"thread_start_us":109,"threads_started":1}
I20260809 07:58:39.931075 17037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.925810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:44357 (local address 127.8.51.65:39747)
0809 07:58:39.925951 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.925957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.926187 (+ 230us) server_negotiation.cc:407] Connection header received
0809 07:58:39.926282 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.926285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.926340 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.926412 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:39.926695 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.927466 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.929782 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.930437 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.930536 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.930605 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.930871 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.930952 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 07:58:39.931236 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce74a0133c5432fad70f80896c41e63" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610" is_pre_election: true
I20260809 07:58:39.931582 16959 raft_consensus.cc:2454] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 0.
I20260809 07:58:39.931887 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce74a0133c5432fad70f80896c41e63" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" is_pre_election: true
I20260809 07:58:39.932142 16734 leader_election.cc:302] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 4dcfa4a3796c4d9bbbc2f477e5224c7b; no voters:
I20260809 07:58:39.932194 16653 raft_consensus.cc:2454] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 0.
I20260809 07:58:39.932417 17044 raft_consensus.cc:2781] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:39.932518 17044 raft_consensus.cc:482] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:39.932583 17044 raft_consensus.cc:3037] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:39.933717 17044 raft_consensus.cc:504] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
I20260809 07:58:39.934047 17044 leader_election.cc:288] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 election: Requested vote from peers 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037), 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747)
I20260809 07:58:39.934396 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce74a0133c5432fad70f80896c41e63" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
I20260809 07:58:39.934407 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce74a0133c5432fad70f80896c41e63" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610"
I20260809 07:58:39.934535 16959 raft_consensus.cc:3037] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:39.934514 16653 raft_consensus.cc:3037] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:39.935599 16653 raft_consensus.cc:2454] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 1.
I20260809 07:58:39.935904 16732 leader_election.cc:302] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dcfa4a3796c4d9bbbc2f477e5224c7b, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:39.935976 16959 raft_consensus.cc:2454] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 1.
I20260809 07:58:39.936108 17044 raft_consensus.cc:2781] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:39.936339 17044 raft_consensus.cc:686] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 LEADER]: Becoming Leader. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Running, Role: LEADER
I20260809 07:58:39.936656 17044 consensus_queue.cc:237] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } }
W20260809 07:58:39.938853 16861 tablet.cc:2369] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:39.939922 16483 catalog_manager.cc:5495] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66). New cstate: current_term: 1 leader_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:39.958827 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:39.955955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38926 (local address 127.8.51.66:34767)
0809 07:58:39.956072 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:39.956078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:39.956095 (+ 17us) server_negotiation.cc:407] Connection header received
0809 07:58:39.956196 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:39.956199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:39.956257 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:39.956354 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:39.956532 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.956958 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.957726 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:39.957908 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:39.957977 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:39.958184 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:39.958555 (+ 371us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:39.958637 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:39.958698 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 07:58:39.958738 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 07:58:39.963953 16653 raft_consensus.cc:1261] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Refusing update from remote peer 4dcfa4a3796c4d9bbbc2f477e5224c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:39.963954 16959 raft_consensus.cc:1261] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Refusing update from remote peer 4dcfa4a3796c4d9bbbc2f477e5224c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:39.964615 17044 consensus_queue.cc:1035] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:39.964809 17049 consensus_queue.cc:1035] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:39.971917 17053 mvcc.cc:205] Tried to move back new op lower bound from 7316530462566178816 to 7316530462463168512. Current Snapshot: MvccSnapshot[applied={T|T < 7316530462566178816}]
W20260809 07:58:39.975679 16706 tablet.cc:2369] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:58:39.978586 16483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:39.978739 16483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:39.981298 16483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Sending DeleteTablet for 3 replicas of tablet 0ce74a0133c5432fad70f80896c41e63
I20260809 07:58:39.981858 16938 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce74a0133c5432fad70f80896c41e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:39 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:43306
I20260809 07:58:39.981921 16787 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce74a0133c5432fad70f80896c41e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:39 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:38920
I20260809 07:58:39.982200 16630 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce74a0133c5432fad70f80896c41e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:39 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 07:58:39.982440 17064 tablet_replica.cc:330] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: stopping tablet replica
I20260809 07:58:39.982672 17065 tablet_replica.cc:330] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: stopping tablet replica
I20260809 07:58:39.982736 17064 raft_consensus.cc:2229] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:39.982723 16629 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce74a0133c5432fad70f80896c41e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:39 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 07:58:39.983031 17064 raft_consensus.cc:2258] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:39.983312 17065 raft_consensus.cc:2229] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:39.983528 16483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 07:58:39.983640 17065 raft_consensus.cc:2258] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 07:58:39.983897 16483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:39.984764 17064 ts_tablet_manager.cc:1905] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:39.985313 17065 ts_tablet_manager.cc:1905] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:39.987583 17064 ts_tablet_manager.cc:1918] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:39.987684 17064 log.cc:1196] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/0ce74a0133c5432fad70f80896c41e63
I20260809 07:58:39.987962 17065 ts_tablet_manager.cc:1918] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:39.988040 17064 ts_tablet_manager.cc:1939] T 0ce74a0133c5432fad70f80896c41e63 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting consensus metadata
I20260809 07:58:39.988159 17065 log.cc:1196] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/0ce74a0133c5432fad70f80896c41e63
I20260809 07:58:39.988487 17065 ts_tablet_manager.cc:1939] T 0ce74a0133c5432fad70f80896c41e63 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting consensus metadata
I20260809 07:58:39.988948 16787 tablet_service.cc:1467] Processing CreateTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 (DEFAULT_TABLE table=test-table [id=7cf42119825c4600a56441878aea1481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.989014 16468 catalog_manager.cc:4841] TS 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767): tablet 0ce74a0133c5432fad70f80896c41e63 (table test-table [id=a436f90d56c34edda5ab41f698f8beff]) successfully deleted
I20260809 07:58:39.989202 16787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef522bfca3a4cf08afbe642e74f84f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.989673 16629 tablet_service.cc:1467] Processing CreateTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 (DEFAULT_TABLE table=test-table [id=7cf42119825c4600a56441878aea1481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.989673 16938 tablet_service.cc:1467] Processing CreateTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 (DEFAULT_TABLE table=test-table [id=7cf42119825c4600a56441878aea1481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:39.989902 16629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef522bfca3a4cf08afbe642e74f84f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.989902 16938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef522bfca3a4cf08afbe642e74f84f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:39.990887 17039 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Bootstrap starting.
I20260809 07:58:39.991811 17039 tablet_bootstrap.cc:654] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.992043 17040 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Bootstrap starting.
I20260809 07:58:39.992405 17038 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Bootstrap starting.
I20260809 07:58:39.993057 17040 tablet_bootstrap.cc:654] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.993304 17038 tablet_bootstrap.cc:654] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:39.993637 16469 catalog_manager.cc:4841] TS 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747): tablet 0ce74a0133c5432fad70f80896c41e63 (table test-table [id=a436f90d56c34edda5ab41f698f8beff]) successfully deleted
W20260809 07:58:39.993903 16469 catalog_manager.cc:4808] TS 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747): delete failed for tablet 0ce74a0133c5432fad70f80896c41e63 because the tablet was not found. No further retry: Not found: Tablet not found: 0ce74a0133c5432fad70f80896c41e63
I20260809 07:58:39.994284 17040 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: No bootstrap required, opened a new log
I20260809 07:58:39.994364 17040 ts_tablet_manager.cc:1397] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 07:58:39.994810 17038 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: No bootstrap required, opened a new log
I20260809 07:58:39.994882 17038 ts_tablet_manager.cc:1397] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 07:58:39.994835 17040 raft_consensus.cc:348] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.994937 17040 raft_consensus.cc:374] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.994971 17040 raft_consensus.cc:729] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.995112 17040 consensus_queue.cc:260] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.995285 17038 raft_consensus.cc:348] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.995378 17038 raft_consensus.cc:374] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.995383 17040 ts_tablet_manager.cc:1428] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:39.995407 17038 raft_consensus.cc:729] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.995427 17063 tablet_replica.cc:330] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: stopping tablet replica
I20260809 07:58:39.995514 17038 consensus_queue.cc:260] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.995765 17038 ts_tablet_manager.cc:1428] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:39.995764 17063 raft_consensus.cc:2229] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:39.996141 17063 raft_consensus.cc:2258] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:39.996290 17039 tablet_bootstrap.cc:492] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: No bootstrap required, opened a new log
I20260809 07:58:39.996367 17039 ts_tablet_manager.cc:1397] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 07:58:39.996788 17039 raft_consensus.cc:348] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.996899 17039 raft_consensus.cc:374] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:39.996932 17039 raft_consensus.cc:729] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Initialized, Role: FOLLOWER
I20260809 07:58:39.997037 17039 consensus_queue.cc:260] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:39.997277 17039 ts_tablet_manager.cc:1428] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:39.999454 17063 ts_tablet_manager.cc:1905] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.001884 17063 ts_tablet_manager.cc:1918] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:40.001960 17063 log.cc:1196] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/0ce74a0133c5432fad70f80896c41e63
I20260809 07:58:40.002183 17063 ts_tablet_manager.cc:1939] T 0ce74a0133c5432fad70f80896c41e63 P 374db79f9904466486e30ccf6cafc610: Deleting consensus metadata
I20260809 07:58:40.003151 16471 catalog_manager.cc:4841] TS 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037): tablet 0ce74a0133c5432fad70f80896c41e63 (table test-table [id=a436f90d56c34edda5ab41f698f8beff]) successfully deleted
I20260809 07:58:40.365379 17047 raft_consensus.cc:482] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:40.365550 17047 raft_consensus.cc:504] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.366869 17047 leader_election.cc:288] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:40.370838 17070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.367113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:34767 (local address 127.8.51.65:54001)
0809 07:58:40.367545 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.367557 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.367688 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.367967 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.367971 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.367991 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:40.368135 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.368139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.368839 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.368845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.369739 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.369748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.370377 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.370384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.370484 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.370510 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.370582 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.370669 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":141,"thread_start_us":129,"threads_started":1}
I20260809 07:58:40.370832 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.367236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:54001 (local address 127.8.51.66:34767)
0809 07:58:40.367373 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.367377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.367627 (+ 250us) server_negotiation.cc:407] Connection header received
0809 07:58:40.367808 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.367810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.367848 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.367938 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:40.368269 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.368731 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.369855 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.370259 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.370338 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.370417 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.370623 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.370707 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:40.370889 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.367232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:55917 (local address 127.8.51.67:46037)
0809 07:58:40.367373 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.367377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.367561 (+ 184us) server_negotiation.cc:407] Connection header received
0809 07:58:40.367758 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.367763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.367823 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.367880 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:40.368223 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.368728 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.369927 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.370323 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.370432 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.370496 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.370688 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.370768 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:58:40.371039 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.367113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:46037 (local address 127.8.51.65:55917)
0809 07:58:40.367455 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.367467 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.367602 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.367916 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.367921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.367941 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:40.368108 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.368114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.368863 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.368866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.369787 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.369814 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.370446 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.370450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.370543 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.370560 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.370655 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.370772 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":41,"thread_start_us":78,"threads_started":1}
I20260809 07:58:40.371737 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef522bfca3a4cf08afbe642e74f84f5" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610" is_pre_election: true
I20260809 07:58:40.371810 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef522bfca3a4cf08afbe642e74f84f5" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" is_pre_election: true
I20260809 07:58:40.371927 16959 raft_consensus.cc:2454] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 0.
I20260809 07:58:40.372013 16809 raft_consensus.cc:2454] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 0.
I20260809 07:58:40.372320 16584 leader_election.cc:302] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:40.372601 17047 raft_consensus.cc:2781] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:40.372663 17047 raft_consensus.cc:482] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:40.372704 17047 raft_consensus.cc:3037] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.373776 17047 raft_consensus.cc:504] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.374097 17047 leader_election.cc:288] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 election: Requested vote from peers 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:40.374372 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef522bfca3a4cf08afbe642e74f84f5" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
I20260809 07:58:40.374439 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef522bfca3a4cf08afbe642e74f84f5" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610"
I20260809 07:58:40.374508 16809 raft_consensus.cc:3037] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.374565 16959 raft_consensus.cc:3037] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.375466 16809 raft_consensus.cc:2454] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 1.
I20260809 07:58:40.375520 16959 raft_consensus.cc:2454] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 1.
I20260809 07:58:40.375783 16581 leader_election.cc:302] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dcfa4a3796c4d9bbbc2f477e5224c7b, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:40.375960 17047 raft_consensus.cc:2781] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:40.376187 17047 raft_consensus.cc:686] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 LEADER]: Becoming Leader. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Running, Role: LEADER
I20260809 07:58:40.376470 17047 consensus_queue.cc:237] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.378574 16484 catalog_manager.cc:5495] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65). New cstate: current_term: 1 leader_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } health_report { overall_health: UNKNOWN } } }
Aug 09 07:58:40 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262318, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.126@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:40.491925 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.483237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45585 (local address 127.0.0.1:53366)
0809 07:58:40.483570 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.483583 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.483701 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.483944 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.483946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.484356 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:40.484452 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.484458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.485223 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.485225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.485851 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.485861 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.486267 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.486269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.486330 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.486952 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:40.486964 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:40.488461 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:40.490431 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:40.490439 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:40.490444 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:40.490764 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:40.491010 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:40.491012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:40.491013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:40.491102 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:40.491428 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:40.491433 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:40.491532 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.491625 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.491744 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":92,"threads_started":1}
I20260809 07:58:40.491930 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.483295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53366 (local address 127.8.51.126:45585)
0809 07:58:40.483579 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.483587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.483666 (+ 79us) server_negotiation.cc:407] Connection header received
0809 07:58:40.483781 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.483783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.483822 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.483901 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:40.484577 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.485104 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.485951 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.486167 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.486242 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.488626 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:40.488630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:40.488633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:40.488653 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:40.490331 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:40.490851 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:40.490854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:40.490855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:40.490930 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:40.491178 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:40.491180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:40.491181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:40.491340 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:40.491413 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.491681 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.491801 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":217,"thread_start_us":124,"threads_started":1}
I20260809 07:58:40.495579 16484 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53366:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 07:58:40.496397 16484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:40.501468 16629 tablet_service.cc:1467] Processing CreateTablet for tablet d5ae21502d214a49bcbe0f33b4afb2f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c0807f88f19d4225b72e13092f67ba70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:40.501922 16629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ae21502d214a49bcbe0f33b4afb2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.501801 16787 tablet_service.cc:1467] Processing CreateTablet for tablet d5ae21502d214a49bcbe0f33b4afb2f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c0807f88f19d4225b72e13092f67ba70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:40.501938 16938 tablet_service.cc:1467] Processing CreateTablet for tablet d5ae21502d214a49bcbe0f33b4afb2f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c0807f88f19d4225b72e13092f67ba70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 07:58:40.502156 16787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ae21502d214a49bcbe0f33b4afb2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.502235 16938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ae21502d214a49bcbe0f33b4afb2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.504786 17081 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: Bootstrap starting.
I20260809 07:58:40.505128 17082 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Bootstrap starting.
I20260809 07:58:40.505246 17083 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Bootstrap starting.
I20260809 07:58:40.505926 17081 tablet_bootstrap.cc:654] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.506142 17082 tablet_bootstrap.cc:654] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.506186 17083 tablet_bootstrap.cc:654] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.507100 17081 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: No bootstrap required, opened a new log
I20260809 07:58:40.507216 17081 ts_tablet_manager.cc:1397] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:40.507254 17083 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: No bootstrap required, opened a new log
I20260809 07:58:40.507323 17083 ts_tablet_manager.cc:1397] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 07:58:40.507650 17083 raft_consensus.cc:348] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.507731 17083 raft_consensus.cc:374] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.507752 17083 raft_consensus.cc:729] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.507658 17081 raft_consensus.cc:348] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.507787 17081 raft_consensus.cc:374] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.507824 17081 raft_consensus.cc:729] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.507882 17083 consensus_queue.cc:260] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.507954 17081 consensus_queue.cc:260] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.508198 17083 ts_tablet_manager.cc:1428] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:40.508133 17047 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.508276 17047 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.508298 17081 ts_tablet_manager.cc:1428] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:40.508699 17088 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.508841 17088 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.509017 17082 tablet_bootstrap.cc:492] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: No bootstrap required, opened a new log
I20260809 07:58:40.509110 17082 ts_tablet_manager.cc:1397] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 07:58:40.509545 17082 raft_consensus.cc:348] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.509735 17082 raft_consensus.cc:374] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.509778 17082 raft_consensus.cc:729] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.509912 17082 consensus_queue.cc:260] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.510274 17082 ts_tablet_manager.cc:1428] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 07:58:40.510260 17089 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.510468 17089 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.594606 17088 raft_consensus.cc:482] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:40.594732 17088 raft_consensus.cc:504] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.595857 17088 leader_election.cc:288] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747), 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767)
I20260809 07:58:40.599880 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.596203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:33077 (local address 127.8.51.66:34767)
0809 07:58:40.596326 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.596332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.596548 (+ 216us) server_negotiation.cc:407] Connection header received
0809 07:58:40.596666 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.596670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.596724 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.596809 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:40.597128 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.597630 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.598711 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.599102 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.599225 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.599285 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.599687 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.599760 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:58:40.599902 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.596182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38915 (local address 127.8.51.65:39747)
0809 07:58:40.596408 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.596415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.596455 (+ 40us) server_negotiation.cc:407] Connection header received
0809 07:58:40.596629 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.596633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.596677 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.596767 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:58:40.597055 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.597652 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.598734 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.599162 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.599277 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.599340 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.599613 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.599717 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":69,"threads_started":1}
I20260809 07:58:40.599893 17091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.596041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:39747 (local address 127.8.51.67:38915)
0809 07:58:40.596372 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.596386 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.596507 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.596777 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.596780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.596795 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:40.596942 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.596947 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.597754 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.597760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.598600 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.598608 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.599278 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.599282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.599441 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.599467 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.599552 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.599712 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":51,"thread_start_us":94,"threads_started":1}
I20260809 07:58:40.600241 17090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.596082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:34767 (local address 127.8.51.67:33077)
0809 07:58:40.596446 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.596457 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.596579 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.596819 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.596821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.596862 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:58:40.597013 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.597019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.597740 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.597745 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.598583 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.598592 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.599361 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.599365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.599471 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.599505 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.600063 (+ 558us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.600135 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":53,"spinlock_wait_cycles":39680,"thread_start_us":114,"threads_started":1}
I20260809 07:58:40.600680 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ae21502d214a49bcbe0f33b4afb2f2" candidate_uuid: "374db79f9904466486e30ccf6cafc610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" is_pre_election: true
I20260809 07:58:40.600840 16809 raft_consensus.cc:2454] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 374db79f9904466486e30ccf6cafc610 in term 0.
I20260809 07:58:40.600978 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ae21502d214a49bcbe0f33b4afb2f2" candidate_uuid: "374db79f9904466486e30ccf6cafc610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" is_pre_election: true
I20260809 07:58:40.601157 16653 raft_consensus.cc:2454] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 374db79f9904466486e30ccf6cafc610 in term 0.
I20260809 07:58:40.601202 16886 leader_election.cc:302] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 4dcfa4a3796c4d9bbbc2f477e5224c7b; no voters:
I20260809 07:58:40.601483 17088 raft_consensus.cc:2781] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:40.601549 17088 raft_consensus.cc:482] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:40.601615 17088 raft_consensus.cc:3037] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.602576 17088 raft_consensus.cc:504] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.602912 17088 leader_election.cc:288] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747), 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767)
I20260809 07:58:40.603229 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ae21502d214a49bcbe0f33b4afb2f2" candidate_uuid: "374db79f9904466486e30ccf6cafc610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
I20260809 07:58:40.603344 16653 raft_consensus.cc:3037] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.603334 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ae21502d214a49bcbe0f33b4afb2f2" candidate_uuid: "374db79f9904466486e30ccf6cafc610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
I20260809 07:58:40.603467 16809 raft_consensus.cc:3037] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.604305 16653 raft_consensus.cc:2454] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 374db79f9904466486e30ccf6cafc610 in term 1.
I20260809 07:58:40.604526 16809 raft_consensus.cc:2454] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 374db79f9904466486e30ccf6cafc610 in term 1.
I20260809 07:58:40.604599 16887 leader_election.cc:302] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:40.604794 17088 raft_consensus.cc:2781] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:40.605010 17088 raft_consensus.cc:686] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [term 1 LEADER]: Becoming Leader. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Running, Role: LEADER
I20260809 07:58:40.605304 17088 consensus_queue.cc:237] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.606923 17093 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: TxnStatusTablet state changed. Reason: New leader 374db79f9904466486e30ccf6cafc610. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.607029 17093 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:40.607292 17095 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 07:58:40.607435 17095 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 07:58:40.608114 16483 catalog_manager.cc:5495] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 374db79f9904466486e30ccf6cafc610 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } health_report { overall_health: HEALTHY } } }
I20260809 07:58:40.633780 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.629521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43310 (local address 127.8.51.67:46037)
0809 07:58:40.629676 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.629683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.629769 (+ 86us) server_negotiation.cc:407] Connection header received
0809 07:58:40.629960 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.629963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.630057 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.630149 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:40.630396 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.630984 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.632287 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.632492 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.632572 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.632885 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.633353 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.633439 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.633562 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.633653 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 07:58:40.633792 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.629423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:46037 (local address 127.0.0.1:43310)
0809 07:58:40.629687 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.629703 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.629816 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.630173 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.630176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.630185 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:40.630294 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.630300 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.631109 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.631113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.632168 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.632179 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.632603 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.632606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.632698 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.632750 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.633452 (+ 702us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.633466 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.633539 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.633653 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 07:58:40.636929 16653 raft_consensus.cc:1261] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Refusing update from remote peer 374db79f9904466486e30ccf6cafc610: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.637141 16809 raft_consensus.cc:1261] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Refusing update from remote peer 374db79f9904466486e30ccf6cafc610: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.637449 17093 consensus_queue.cc:1035] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.637668 17088 consensus_queue.cc:1035] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.639038 17047 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: TxnStatusTablet state changed. Reason: New leader 374db79f9904466486e30ccf6cafc610. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.639163 17047 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.639278 17089 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: TxnStatusTablet state changed. Reason: New leader 374db79f9904466486e30ccf6cafc610. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.639397 17089 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.641212 17093 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.641321 17093 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:40.641637 17093 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.641765 17093 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 374db79f9904466486e30ccf6cafc610: This TxnStatusTablet replica's current role is: LEADER
I20260809 07:58:40.642525 17089 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.642624 17089 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.642890 17047 tablet_replica.cc:439] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "374db79f9904466486e30ccf6cafc610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } } }
I20260809 07:58:40.642993 17047 tablet_replica.cc:442] T d5ae21502d214a49bcbe0f33b4afb2f2 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 07:58:40.643620 17100 mvcc.cc:205] Tried to move back new op lower bound from 7316530465324003328 to 7316530465201922048. Current Snapshot: MvccSnapshot[applied={T|T < 7316530465324003328}]
I20260809 07:58:40.644538 17101 mvcc.cc:205] Tried to move back new op lower bound from 7316530465324003328 to 7316530465201922048. Current Snapshot: MvccSnapshot[applied={T|T < 7316530465324003328}]
I20260809 07:58:40.652942 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.649238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53258 (local address 127.8.51.65:39747)
0809 07:58:40.649364 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.649370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.649565 (+ 195us) server_negotiation.cc:407] Connection header received
0809 07:58:40.649766 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.649770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.649845 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.649951 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:40.650204 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.650684 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.651514 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.651775 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.651883 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.652145 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.652559 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.652689 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.652767 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.652819 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:58:40.670300 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.659806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:54737 (local address 127.8.51.67:46037)
0809 07:58:40.666562 (+ 6756us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.666567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.666584 (+ 17us) server_negotiation.cc:407] Connection header received
0809 07:58:40.666633 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.666636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.666686 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.666774 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:40.667134 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.667895 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.669053 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.669395 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.669492 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.669836 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.669911 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.669977 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.670115 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.670174 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6669}
I20260809 07:58:40.670333 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.659654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:46037 (local address 127.8.51.65:54737)
0809 07:58:40.659998 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.660012 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.660096 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.666817 (+ 6721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.666820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.666830 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:40.667005 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.667012 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.668003 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.668007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.668930 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.668940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.669517 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.669521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.669645 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.669706 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.670012 (+ 306us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.670019 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.670084 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.670163 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":102,"threads_started":1}
I20260809 07:58:40.677515 16809 raft_consensus.cc:1261] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Refusing update from remote peer 9ad2c229f4f8416c88bb8d4ef9b9cdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.677558 16959 raft_consensus.cc:1261] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Refusing update from remote peer 9ad2c229f4f8416c88bb8d4ef9b9cdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.677963 17047 consensus_queue.cc:1035] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.678119 17071 consensus_queue.cc:1035] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.701040 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.696762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:59241 (local address 127.8.51.65:39747)
0809 07:58:40.696881 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.696884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.697131 (+ 247us) server_negotiation.cc:407] Connection header received
0809 07:58:40.697321 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.697324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.697377 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.697453 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:40.697739 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.698507 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.699834 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.700119 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.700208 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.700583 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.700664 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.700707 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.700858 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.700909 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:58:40.701643 17117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.696675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:39747 (local address 127.8.51.67:59241)
0809 07:58:40.697047 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:40.697062 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:40.697176 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:40.697465 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:40.697468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:40.697476 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 07:58:40.697630 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.697637 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.698639 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.698642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.699650 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:40.699663 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.700261 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.700265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:40.700362 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.700431 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.700766 (+ 335us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.700771 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 07:58:40.701375 (+ 604us) client_negotiation.cc:240] Negotiation successful
0809 07:58:40.701456 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":100,"threads_started":1}
I20260809 07:58:40.726361 16482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:40.726527 16482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:40.729642 16482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Sending DeleteTablet for 3 replicas of tablet cef522bfca3a4cf08afbe642e74f84f5
I20260809 07:58:40.730358 16787 tablet_service.cc:1514] Processing DeleteTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:38920
I20260809 07:58:40.730587 16629 tablet_service.cc:1514] Processing DeleteTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 07:58:40.730679 16938 tablet_service.cc:1514] Processing DeleteTablet for tablet cef522bfca3a4cf08afbe642e74f84f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:43306
I20260809 07:58:40.731295 17122 tablet_replica.cc:330] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: stopping tablet replica
I20260809 07:58:40.731467 17122 raft_consensus.cc:2229] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:40.731796 17122 raft_consensus.cc:2258] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.732102 17123 tablet_replica.cc:330] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: stopping tablet replica
I20260809 07:58:40.732303 17123 raft_consensus.cc:2229] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:40.732460 17123 raft_consensus.cc:2258] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.732782 17122 ts_tablet_manager.cc:1905] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.733237 17123 ts_tablet_manager.cc:1905] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.736048 17122 ts_tablet_manager.cc:1918] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:40.736047 17123 ts_tablet_manager.cc:1918] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:40.736131 17123 log.cc:1196] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/cef522bfca3a4cf08afbe642e74f84f5
I20260809 07:58:40.736131 17122 log.cc:1196] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/cef522bfca3a4cf08afbe642e74f84f5
I20260809 07:58:40.736408 17122 ts_tablet_manager.cc:1939] T cef522bfca3a4cf08afbe642e74f84f5 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting consensus metadata
I20260809 07:58:40.736408 17123 ts_tablet_manager.cc:1939] T cef522bfca3a4cf08afbe642e74f84f5 P 374db79f9904466486e30ccf6cafc610: Deleting consensus metadata
I20260809 07:58:40.737205 16469 catalog_manager.cc:4841] TS 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747): tablet cef522bfca3a4cf08afbe642e74f84f5 (table test-table [id=7cf42119825c4600a56441878aea1481]) successfully deleted
I20260809 07:58:40.737382 16471 catalog_manager.cc:4841] TS 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037): tablet cef522bfca3a4cf08afbe642e74f84f5 (table test-table [id=7cf42119825c4600a56441878aea1481]) successfully deleted
I20260809 07:58:40.737749 17121 tablet_replica.cc:330] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: stopping tablet replica
I20260809 07:58:40.737972 17121 raft_consensus.cc:2229] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:40.738152 17121 raft_consensus.cc:2258] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.738847 17121 ts_tablet_manager.cc:1905] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.741631 17121 ts_tablet_manager.cc:1918] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:40.741775 17121 log.cc:1196] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/cef522bfca3a4cf08afbe642e74f84f5
I20260809 07:58:40.742174 17121 ts_tablet_manager.cc:1939] T cef522bfca3a4cf08afbe642e74f84f5 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting consensus metadata
I20260809 07:58:40.742898 16468 catalog_manager.cc:4841] TS 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767): tablet cef522bfca3a4cf08afbe642e74f84f5 (table test-table [id=7cf42119825c4600a56441878aea1481]) successfully deleted
Aug 09 07:58:40 dist-test-slave-njxd krb5kdc[16438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 07:58:40 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:40 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 07:58:40.767446 17080 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:40.759752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.8.51.126:45585)
0809 07:58:40.759879 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.759884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.760132 (+ 248us) server_negotiation.cc:407] Connection header received
0809 07:58:40.760254 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.760257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.760310 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.760399 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:40.761287 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.762187 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.763368 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.763688 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.763793 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.767328 (+ 3535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53378: BlockingRecv error: recv got EOF from 127.0.0.1:53378 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 07:58:40 dist-test-slave-njxd krb5kdc[16438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM
I20260809 07:58:40.778980 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.768875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53390 (local address 127.8.51.126:45585)
0809 07:58:40.768968 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.768971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.769373 (+ 402us) server_negotiation.cc:407] Connection header received
0809 07:58:40.769470 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.769474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.769519 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.769651 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:40.770281 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.771065 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.772134 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.772450 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.772550 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.775259 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:40.775263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:40.775265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:40.775290 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:40.777021 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:40.777653 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:40.777657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:40.777659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:40.777745 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:40.778029 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:40.778032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:40.778034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:40.778216 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:40.778311 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.778703 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.778820 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 07:58:40.781965 16482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:58:40.782390 16482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:40.787266 16629 tablet_service.cc:1467] Processing CreateTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 (DEFAULT_TABLE table=test-table [id=d484aed44ec74179878f7cbcf3dcca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:40.787547 16629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13094e41fe34f4f971b2a1d2e3f65a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.787647 16787 tablet_service.cc:1467] Processing CreateTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 (DEFAULT_TABLE table=test-table [id=d484aed44ec74179878f7cbcf3dcca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:40.787938 16787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13094e41fe34f4f971b2a1d2e3f65a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.789290 16938 tablet_service.cc:1467] Processing CreateTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 (DEFAULT_TABLE table=test-table [id=d484aed44ec74179878f7cbcf3dcca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:40.789548 16938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13094e41fe34f4f971b2a1d2e3f65a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:40.791637 17081 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Bootstrap starting.
I20260809 07:58:40.791713 17083 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Bootstrap starting.
I20260809 07:58:40.792446 17081 tablet_bootstrap.cc:654] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.792665 17083 tablet_bootstrap.cc:654] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.793916 17081 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: No bootstrap required, opened a new log
I20260809 07:58:40.794006 17081 ts_tablet_manager.cc:1397] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:40.794399 17081 raft_consensus.cc:348] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.794505 17081 raft_consensus.cc:374] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.794551 17081 raft_consensus.cc:729] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.794584 17082 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Bootstrap starting.
I20260809 07:58:40.794675 17081 consensus_queue.cc:260] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.794926 17081 ts_tablet_manager.cc:1428] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:40.795447 17082 tablet_bootstrap.cc:654] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:40.795558 17083 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: No bootstrap required, opened a new log
I20260809 07:58:40.795634 17083 ts_tablet_manager.cc:1397] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260809 07:58:40.796111 17083 raft_consensus.cc:348] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.796214 17083 raft_consensus.cc:374] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.796249 17083 raft_consensus.cc:729] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.796380 17083 consensus_queue.cc:260] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.796665 17083 ts_tablet_manager.cc:1428] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:40.797163 17082 tablet_bootstrap.cc:492] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: No bootstrap required, opened a new log
I20260809 07:58:40.797250 17082 ts_tablet_manager.cc:1397] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 07:58:40.797689 17082 raft_consensus.cc:348] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.797796 17082 raft_consensus.cc:374] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:40.797837 17082 raft_consensus.cc:729] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Initialized, Role: FOLLOWER
I20260809 07:58:40.797967 17082 consensus_queue.cc:260] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.798242 17082 ts_tablet_manager.cc:1428] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 07:58:40.961886 17089 raft_consensus.cc:482] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:40.962023 17089 raft_consensus.cc:504] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.962443 17089 leader_election.cc:288] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:40.962863 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13094e41fe34f4f971b2a1d2e3f65a1" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" is_pre_election: true
I20260809 07:58:40.962903 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13094e41fe34f4f971b2a1d2e3f65a1" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610" is_pre_election: true
I20260809 07:58:40.963023 16653 raft_consensus.cc:2454] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 0.
I20260809 07:58:40.963049 16959 raft_consensus.cc:2454] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 0.
I20260809 07:58:40.963373 16734 leader_election.cc:302] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 4dcfa4a3796c4d9bbbc2f477e5224c7b; no voters:
I20260809 07:58:40.963560 17089 raft_consensus.cc:2781] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:40.963621 17089 raft_consensus.cc:482] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:40.963649 17089 raft_consensus.cc:3037] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.964922 17089 raft_consensus.cc:504] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.965302 17089 leader_election.cc:288] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 election: Requested vote from peers 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:40.965638 16653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13094e41fe34f4f971b2a1d2e3f65a1" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad"
I20260809 07:58:40.965683 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13094e41fe34f4f971b2a1d2e3f65a1" candidate_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610"
I20260809 07:58:40.965770 16653 raft_consensus.cc:3037] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.965794 16959 raft_consensus.cc:3037] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:40.966738 16959 raft_consensus.cc:2454] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 1.
I20260809 07:58:40.966763 16653 raft_consensus.cc:2454] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dcfa4a3796c4d9bbbc2f477e5224c7b in term 1.
I20260809 07:58:40.967007 16734 leader_election.cc:302] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 4dcfa4a3796c4d9bbbc2f477e5224c7b; no voters:
I20260809 07:58:40.967160 17089 raft_consensus.cc:2781] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:40.967378 17089 raft_consensus.cc:686] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 LEADER]: Becoming Leader. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Running, Role: LEADER
I20260809 07:58:40.967518 17089 consensus_queue.cc:237] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:40.969100 16483 catalog_manager.cc:5495] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66). New cstate: current_term: 1 leader_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:40.985105 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:40.982317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38938 (local address 127.8.51.66:34767)
0809 07:58:40.982451 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:40.982455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:40.982468 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:40.982564 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:40.982566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:40.982606 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:40.982674 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:40.982883 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.983357 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.984158 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:40.984472 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:40.984550 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:40.984773 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:40.984835 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:40.984888 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:40.984970 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 07:58:40.985010 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 07:58:40.986873 16653 raft_consensus.cc:1261] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Refusing update from remote peer 4dcfa4a3796c4d9bbbc2f477e5224c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.986873 16959 raft_consensus.cc:1261] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Refusing update from remote peer 4dcfa4a3796c4d9bbbc2f477e5224c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:40.987290 17139 consensus_queue.cc:1035] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.987424 17089 consensus_queue.cc:1035] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:40.995591 16484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:40.995719 16484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:40.997327 16484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Sending DeleteTablet for 3 replicas of tablet d13094e41fe34f4f971b2a1d2e3f65a1
I20260809 07:58:40.997843 16629 tablet_service.cc:1514] Processing DeleteTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 07:58:40.997906 16787 tablet_service.cc:1514] Processing DeleteTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:38920
I20260809 07:58:40.997949 16938 tablet_service.cc:1514] Processing DeleteTablet for tablet d13094e41fe34f4f971b2a1d2e3f65a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:40 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:43306
I20260809 07:58:40.998009 17122 tablet_replica.cc:330] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: stopping tablet replica
I20260809 07:58:40.998061 17121 tablet_replica.cc:330] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: stopping tablet replica
I20260809 07:58:40.998122 17122 raft_consensus.cc:2229] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:40.998165 17121 raft_consensus.cc:2229] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:40.998219 17122 raft_consensus.cc:2258] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.998347 17121 raft_consensus.cc:2258] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.998377 17123 tablet_replica.cc:330] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: stopping tablet replica
I20260809 07:58:40.998482 17123 raft_consensus.cc:2229] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:40.998601 17123 raft_consensus.cc:2258] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:40.998852 17122 ts_tablet_manager.cc:1905] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.998934 16484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 07:58:40.999050 17121 ts_tablet_manager.cc:1905] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:40.999191 17123 ts_tablet_manager.cc:1905] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 07:58:40.999305 16484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:58:41.001350 17122 ts_tablet_manager.cc:1918] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:41.001350 17121 ts_tablet_manager.cc:1918] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:41.001395 17123 ts_tablet_manager.cc:1918] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:58:41.001420 17121 log.cc:1196] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/d13094e41fe34f4f971b2a1d2e3f65a1
I20260809 07:58:41.001420 17122 log.cc:1196] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/d13094e41fe34f4f971b2a1d2e3f65a1
I20260809 07:58:41.001449 17123 log.cc:1196] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/d13094e41fe34f4f971b2a1d2e3f65a1
I20260809 07:58:41.001718 17121 ts_tablet_manager.cc:1939] T d13094e41fe34f4f971b2a1d2e3f65a1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting consensus metadata
I20260809 07:58:41.001718 17122 ts_tablet_manager.cc:1939] T d13094e41fe34f4f971b2a1d2e3f65a1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Deleting consensus metadata
I20260809 07:58:41.001736 17123 ts_tablet_manager.cc:1939] T d13094e41fe34f4f971b2a1d2e3f65a1 P 374db79f9904466486e30ccf6cafc610: Deleting consensus metadata
I20260809 07:58:41.002302 16469 catalog_manager.cc:4841] TS 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747): tablet d13094e41fe34f4f971b2a1d2e3f65a1 (table test-table [id=d484aed44ec74179878f7cbcf3dcca4a]) successfully deleted
I20260809 07:58:41.002310 16471 catalog_manager.cc:4841] TS 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037): tablet d13094e41fe34f4f971b2a1d2e3f65a1 (table test-table [id=d484aed44ec74179878f7cbcf3dcca4a]) successfully deleted
I20260809 07:58:41.002496 16468 catalog_manager.cc:4841] TS 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767): tablet d13094e41fe34f4f971b2a1d2e3f65a1 (table test-table [id=d484aed44ec74179878f7cbcf3dcca4a]) successfully deleted
I20260809 07:58:41.005460 16629 tablet_service.cc:1467] Processing CreateTablet for tablet d1d6b89c00d44463bfaeef660d038be1 (DEFAULT_TABLE table=test-table [id=f262c7092a9a4c109d87fea1d85fe53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:41.005756 16629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d6b89c00d44463bfaeef660d038be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:41.007812 16938 tablet_service.cc:1467] Processing CreateTablet for tablet d1d6b89c00d44463bfaeef660d038be1 (DEFAULT_TABLE table=test-table [id=f262c7092a9a4c109d87fea1d85fe53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:41.008061 16938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d6b89c00d44463bfaeef660d038be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:41.010133 16787 tablet_service.cc:1467] Processing CreateTablet for tablet d1d6b89c00d44463bfaeef660d038be1 (DEFAULT_TABLE table=test-table [id=f262c7092a9a4c109d87fea1d85fe53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:58:41.010258 17083 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Bootstrap starting.
I20260809 07:58:41.010376 16787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d6b89c00d44463bfaeef660d038be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:41.010390 17081 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Bootstrap starting.
I20260809 07:58:41.010937 17083 tablet_bootstrap.cc:654] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:41.011240 17081 tablet_bootstrap.cc:654] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:41.011969 17083 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: No bootstrap required, opened a new log
I20260809 07:58:41.012065 17083 ts_tablet_manager.cc:1397] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 07:58:41.012259 17081 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: No bootstrap required, opened a new log
I20260809 07:58:41.012344 17081 ts_tablet_manager.cc:1397] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 07:58:41.012449 17083 raft_consensus.cc:348] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.012565 17083 raft_consensus.cc:374] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:41.012602 17083 raft_consensus.cc:729] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Initialized, Role: FOLLOWER
I20260809 07:58:41.012729 17082 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Bootstrap starting.
I20260809 07:58:41.012714 17081 raft_consensus.cc:348] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.012737 17083 consensus_queue.cc:260] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.012823 17081 raft_consensus.cc:374] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:41.012871 17081 raft_consensus.cc:729] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374db79f9904466486e30ccf6cafc610, State: Initialized, Role: FOLLOWER
I20260809 07:58:41.012992 17083 ts_tablet_manager.cc:1428] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:41.012970 17081 consensus_queue.cc:260] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.013180 17081 ts_tablet_manager.cc:1428] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 07:58:41.013468 17082 tablet_bootstrap.cc:654] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:41.014679 17082 tablet_bootstrap.cc:492] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: No bootstrap required, opened a new log
I20260809 07:58:41.014784 17082 ts_tablet_manager.cc:1397] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 07:58:41.015178 17082 raft_consensus.cc:348] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.015287 17082 raft_consensus.cc:374] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:41.015332 17082 raft_consensus.cc:729] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dcfa4a3796c4d9bbbc2f477e5224c7b, State: Initialized, Role: FOLLOWER
I20260809 07:58:41.015460 17082 consensus_queue.cc:260] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.015746 17082 ts_tablet_manager.cc:1428] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 07:58:41.076380 17047 raft_consensus.cc:482] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:58:41.076504 17047 raft_consensus.cc:504] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.076908 17047 leader_election.cc:288] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:41.077339 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d6b89c00d44463bfaeef660d038be1" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" is_pre_election: true
I20260809 07:58:41.077404 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d6b89c00d44463bfaeef660d038be1" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610" is_pre_election: true
I20260809 07:58:41.077514 16809 raft_consensus.cc:2454] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 0.
I20260809 07:58:41.077596 16959 raft_consensus.cc:2454] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 0.
I20260809 07:58:41.077839 16581 leader_election.cc:302] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dcfa4a3796c4d9bbbc2f477e5224c7b, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:41.078003 17047 raft_consensus.cc:2781] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:58:41.078071 17047 raft_consensus.cc:482] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:58:41.078117 17047 raft_consensus.cc:3037] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:41.079152 17047 raft_consensus.cc:504] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.079509 17047 leader_election.cc:288] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 election: Requested vote from peers 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767), 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037)
I20260809 07:58:41.079810 16809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d6b89c00d44463bfaeef660d038be1" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b"
I20260809 07:58:41.079865 16959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d6b89c00d44463bfaeef660d038be1" candidate_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374db79f9904466486e30ccf6cafc610"
I20260809 07:58:41.079931 16809 raft_consensus.cc:3037] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:41.079978 16959 raft_consensus.cc:3037] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:41.081089 16809 raft_consensus.cc:2454] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 1.
I20260809 07:58:41.081090 16959 raft_consensus.cc:2454] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad2c229f4f8416c88bb8d4ef9b9cdad in term 1.
I20260809 07:58:41.081357 16584 leader_election.cc:302] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374db79f9904466486e30ccf6cafc610, 9ad2c229f4f8416c88bb8d4ef9b9cdad; no voters:
I20260809 07:58:41.081529 17047 raft_consensus.cc:2781] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:41.081671 17047 raft_consensus.cc:686] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 LEADER]: Becoming Leader. State: Replica: 9ad2c229f4f8416c88bb8d4ef9b9cdad, State: Running, Role: LEADER
I20260809 07:58:41.081810 17047 consensus_queue.cc:237] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } }
I20260809 07:58:41.083359 16484 catalog_manager.cc:5495] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65). New cstate: current_term: 1 leader_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad2c229f4f8416c88bb8d4ef9b9cdad" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 39747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 } health_report { overall_health: UNKNOWN } } }
I20260809 07:58:41.095984 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:41.093217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53270 (local address 127.8.51.65:39747)
0809 07:58:41.093345 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:41.093348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:41.093374 (+ 26us) server_negotiation.cc:407] Connection header received
0809 07:58:41.093495 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:41.093498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:41.093535 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:41.093681 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:58:41.093861 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:41.094345 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:41.095105 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:41.095301 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:41.095374 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:41.095579 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:58:41.095649 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:58:41.095701 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:41.095783 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 07:58:41.095820 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 07:58:41.101807 16959 raft_consensus.cc:1261] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Refusing update from remote peer 9ad2c229f4f8416c88bb8d4ef9b9cdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:41.102114 16809 raft_consensus.cc:1261] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Refusing update from remote peer 9ad2c229f4f8416c88bb8d4ef9b9cdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:58:41.102221 17047 consensus_queue.cc:1035] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "374db79f9904466486e30ccf6cafc610" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:41.102523 17047 consensus_queue.cc:1035] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dcfa4a3796c4d9bbbc2f477e5224c7b" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 34767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:58:41.133301 16484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:41.133460 16484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:58:41.135361 16484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe24fc8e98dc4d8c982c20d2a2917521: Sending DeleteTablet for 3 replicas of tablet d1d6b89c00d44463bfaeef660d038be1
I20260809 07:58:41.135869 16629 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d6b89c00d44463bfaeef660d038be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:41 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 07:58:41.135926 16787 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d6b89c00d44463bfaeef660d038be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:41 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:38920
I20260809 07:58:41.135941 16938 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d6b89c00d44463bfaeef660d038be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:58:41 UTC) from {username='oryx', principal='oryx/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:43306
I20260809 07:58:41.136042 17122 tablet_replica.cc:330] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad: stopping tablet replica
I20260809 07:58:41.136106 17123 tablet_replica.cc:330] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: stopping tablet replica
I20260809 07:58:41.136158 17122 raft_consensus.cc:2229] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:58:41.136225 17123 raft_consensus.cc:2229] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:41.136318 17123 raft_consensus.cc:2258] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:41.136343 17122 raft_consensus.cc:2258] T d1d6b89c00d44463bfaeef660d038be1 P 9ad2c229f4f8416c88bb8d4ef9b9cdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:41.136515 17121 tablet_replica.cc:330] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: stopping tablet replica
I20260809 07:58:41.136646 17121 raft_consensus.cc:2229] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:58:41.136714 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16564
I20260809 07:58:41.136749 17121 raft_consensus.cc:2258] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:58:41.136953 17123 ts_tablet_manager.cc:1905] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:41.139892 17123 ts_tablet_manager.cc:1918] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:41.139900 17121 ts_tablet_manager.cc:1905] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:58:41.139981 17123 log.cc:1196] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/d1d6b89c00d44463bfaeef660d038be1
I20260809 07:58:41.140244 17123 ts_tablet_manager.cc:1939] T d1d6b89c00d44463bfaeef660d038be1 P 374db79f9904466486e30ccf6cafc610: Deleting consensus metadata
I20260809 07:58:41.140940 16471 catalog_manager.cc:4841] TS 374db79f9904466486e30ccf6cafc610 (127.8.51.67:46037): tablet d1d6b89c00d44463bfaeef660d038be1 (table test-table [id=f262c7092a9a4c109d87fea1d85fe53e]) successfully deleted
I20260809 07:58:41.142316 17121 ts_tablet_manager.cc:1918] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 07:58:41.142379 17121 log.cc:1196] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/d1d6b89c00d44463bfaeef660d038be1
I20260809 07:58:41.142608 17121 ts_tablet_manager.cc:1939] T d1d6b89c00d44463bfaeef660d038be1 P 4dcfa4a3796c4d9bbbc2f477e5224c7b: Deleting consensus metadata
I20260809 07:58:41.143177 16468 catalog_manager.cc:4841] TS 4dcfa4a3796c4d9bbbc2f477e5224c7b (127.8.51.66:34767): tablet d1d6b89c00d44463bfaeef660d038be1 (table test-table [id=f262c7092a9a4c109d87fea1d85fe53e]) successfully deleted
I20260809 07:58:41.147696 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16714
W20260809 07:58:41.147694 16469 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:39747 (error 108)
I20260809 07:58:41.149012 17152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:41.148455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:39747 (local address 127.0.0.1:53276)
0809 07:58:41.148820 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:41.148893 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:39747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":76,"threads_started":1}
W20260809 07:58:41.149117 16469 catalog_manager.cc:4584] TS 9ad2c229f4f8416c88bb8d4ef9b9cdad (127.8.51.65:39747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1d6b89c00d44463bfaeef660d038be1: Network error: Client connection negotiation failed: client connection to 127.8.51.65:39747: connect: Connection refused (error 111)
I20260809 07:58:41.156364 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16869
I20260809 07:58:41.163508 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 16451
2026-08-09T07:58:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3612 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:41 dist-test-slave-njxd krb5kdc[17156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:41 dist-test-slave-njxd krb5kdc[17156](info): set up 2 sockets
Aug 09 07:58:41 dist-test-slave-njxd krb5kdc[17156](info): commencing operation
krb5kdc: starting...
W20260809 07:58:42.220197 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:42 dist-test-slave-njxd krb5kdc[17156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:42.342761 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42651
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:42.448931 17174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:42.449194 17174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:42.449235 17174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:42.453179 17174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:42.453236 17174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:42.453255 17174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:42.453271 17174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:42.453286 17174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:42.458272 17174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:42.459189 17174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:42.460144 17174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:42.468762 17180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:42.468746 17179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:42.468887 17174 server_base.cc:1034] running on GCE node
W20260809 07:58:42.468770 17182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:42.469637 17174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:42.470644 17174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:42.471807 17174 hybrid_clock.cc:648] HybridClock initialized: now 1786262322471788 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T07:58:42Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1315 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:58:42 dist-test-slave-njxd krb5kdc[17187](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:58:42 dist-test-slave-njxd krb5kdc[17187](info): set up 2 sockets
Aug 09 07:58:42 dist-test-slave-njxd krb5kdc[17187](info): commencing operation
krb5kdc: starting...
W20260809 07:58:43.511426 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:58:43 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:58:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:58:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:58:43.628523 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:46769
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:46769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:43.737798 17203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:43.738036 17203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:43.738080 17203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:43.742465 17203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:43.742519 17203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:43.742538 17203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:43.742554 17203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:43.742569 17203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:43.747661 17203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:46769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:46769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:43.748612 17203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:43.749567 17203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:43.757885 17209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:43.758051 17203 server_base.cc:1034] running on GCE node
W20260809 07:58:43.757918 17208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:43.758205 17211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:43.758790 17203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:43.759843 17203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:43.761026 17203 hybrid_clock.cc:648] HybridClock initialized: now 1786262323760995 us; error 42 us; skew 500 ppm
Aug 09 07:58:43 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262323, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:43.763659 17203 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:43.764572 17203 webserver.cc:460] Webserver started at http://127.8.51.126:40513/ using document root <none> and password file <none>
I20260809 07:58:43.765136 17203 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:43.765229 17203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:43.765462 17203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:43.767511 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "87b4ebf856d046549d77a4365ab3ef1e"
format_stamp: "Formatted at 2026-08-09 07:58:43 on dist-test-slave-njxd"
server_key: "0287300a8e7cb877c20c1b021b1aac8a"
server_key_iv: "8ad62ca4995ee36114c29abe866124e0"
server_key_version: "encryptionkey@0"
I20260809 07:58:43.768041 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "87b4ebf856d046549d77a4365ab3ef1e"
format_stamp: "Formatted at 2026-08-09 07:58:43 on dist-test-slave-njxd"
server_key: "0287300a8e7cb877c20c1b021b1aac8a"
server_key_iv: "8ad62ca4995ee36114c29abe866124e0"
server_key_version: "encryptionkey@0"
I20260809 07:58:43.771773 17203 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:43.774189 17219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:43.775408 17203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:43.775554 17203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "87b4ebf856d046549d77a4365ab3ef1e"
format_stamp: "Formatted at 2026-08-09 07:58:43 on dist-test-slave-njxd"
server_key: "0287300a8e7cb877c20c1b021b1aac8a"
server_key_iv: "8ad62ca4995ee36114c29abe866124e0"
server_key_version: "encryptionkey@0"
I20260809 07:58:43.775662 17203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:43.803159 17203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:43.806125 17203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:43.806324 17203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:43.813145 17203 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:46769
I20260809 07:58:43.813163 17276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:46769 every 8 connection(s)
I20260809 07:58:43.814121 17203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:43.814960 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17203
I20260809 07:58:43.815083 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:58:43.815390 8397 external_mini_cluster.cc:1428] Setting key 28ad1a20a456925de8263128313086a0
I20260809 07:58:43.817433 17277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:58:43.823992 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Bootstrap starting.
Aug 09 07:58:43 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:43.826740 17277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Neither blocks nor log segments found. Creating new log.
I20260809 07:58:43.827582 17277 log.cc:824] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:43.829879 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: No bootstrap required, opened a new log
I20260809 07:58:43.830360 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:43.816799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46098 (local address 127.8.51.126:46769)
0809 07:58:43.817216 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:43.817231 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:43.817267 (+ 36us) server_negotiation.cc:407] Connection header received
0809 07:58:43.817999 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:43.818019 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:43.818351 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:43.818635 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:43.819561 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:43.820513 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:43.821726 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:43.822198 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:43.822311 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:43.825123 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:43.825130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:43.825146 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:43.825181 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:43.827279 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:43.827710 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:43.827715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:43.827721 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:43.827852 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:43.828179 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:43.828181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:43.828182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:43.828660 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:43.828861 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:43.829131 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 07:58:43.829415 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":145,"threads_started":1}
I20260809 07:58:43.833829 17277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:43.834048 17277 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:58:43.834095 17277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b4ebf856d046549d77a4365ab3ef1e, State: Initialized, Role: FOLLOWER
I20260809 07:58:43.834455 17277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:43.834574 17277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:43.834619 17277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:43.834689 17277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:58:43.835668 17277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:43.835959 17277 leader_election.cc:302] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b4ebf856d046549d77a4365ab3ef1e; no voters:
I20260809 07:58:43.836189 17277 leader_election.cc:288] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:58:43.836298 17282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:58:43.836541 17282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 LEADER]: Becoming Leader. State: Replica: 87b4ebf856d046549d77a4365ab3ef1e, State: Running, Role: LEADER
I20260809 07:58:43.836813 17282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:43.837355 17277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:43.838559 17285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b4ebf856d046549d77a4365ab3ef1e. Latest consensus state: current_term: 1 leader_uuid: "87b4ebf856d046549d77a4365ab3ef1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } } }
I20260809 07:58:43.838708 17285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:43.839120 17292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:43.839035 17284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87b4ebf856d046549d77a4365ab3ef1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } } }
I20260809 07:58:43.839601 17284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:43.842070 17292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:43.846879 17292 catalog_manager.cc:1347] Generated new cluster ID: 4e98d7f55c4f4fb29fa713cee9f610f7
I20260809 07:58:43.846938 17292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:43.857227 17292 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:58:43.858479 17292 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:43.867617 17292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Generated new TSK 0
I20260809 07:58:43.868444 17292 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:58:43.900828 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:44.026515 17304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:44.026743 17304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:44.026816 17304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:44.030722 17304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:44.030773 17304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:44.030862 17304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:44.035943 17304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:44.036888 17304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:44.037982 17304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:44.047268 17313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.047310 17310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.047268 17311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:44.047613 17304 server_base.cc:1034] running on GCE node
I20260809 07:58:44.048029 17304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:44.048605 17304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:44.049777 17304 hybrid_clock.cc:648] HybridClock initialized: now 1786262324049742 us; error 47 us; skew 500 ppm
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:44.052363 17304 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:58:44.053133 17304 webserver.cc:460] Webserver started at http://127.8.51.65:40911/ using document root <none> and password file <none>
I20260809 07:58:44.053711 17304 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:44.053797 17304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:44.054014 17304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:44.056003 17304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "bc59eb2853cc40cb89817cf6ce619d30"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "663fe3706fc43f3ba8409fdddda73d5e"
server_key_iv: "2b91680cf364a9c276c8867f3c69583a"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.056551 17304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "bc59eb2853cc40cb89817cf6ce619d30"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "663fe3706fc43f3ba8409fdddda73d5e"
server_key_iv: "2b91680cf364a9c276c8867f3c69583a"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.059976 17304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:44.062202 17320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.063323 17304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:44.063449 17304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "bc59eb2853cc40cb89817cf6ce619d30"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "663fe3706fc43f3ba8409fdddda73d5e"
server_key_iv: "2b91680cf364a9c276c8867f3c69583a"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.063548 17304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:44.079710 17304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:44.082504 17304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:44.082712 17304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:44.083230 17304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:44.083958 17304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:44.084022 17304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.084088 17304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:44.084124 17304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.092268 17304 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:45177
I20260809 07:58:44.092293 17443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:45177 every 8 connection(s)
I20260809 07:58:44.093043 17304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:44.097380 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17304
I20260809 07:58:44.097504 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:58:44.097812 8397 external_mini_cluster.cc:1428] Setting key 4c15c95a45ee1511826ab5f7f78d1774
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:44.107615 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.094732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:57161 (local address 127.8.51.126:46769)
0809 07:58:44.094862 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:44.094865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:44.095826 (+ 961us) server_negotiation.cc:407] Connection header received
0809 07:58:44.096673 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:44.096677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:44.096739 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:44.096844 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:44.098294 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.098982 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.100517 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.100766 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.100846 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.103578 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:44.103584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:44.103590 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:44.103621 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:44.105399 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.105984 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.105990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.105994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.106108 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.106480 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.106485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.106488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.106744 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:44.106870 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:44.107304 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 07:58:44.107432 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 07:58:44.108160 17446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.095022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:57161)
0809 07:58:44.095623 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:44.095671 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:44.096415 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:44.097022 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:44.097029 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:44.097529 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:44.098136 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.098156 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.099122 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.099127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.100399 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.100413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.100922 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.100928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.101133 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.101759 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:44.101781 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:44.103414 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:44.105518 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.105542 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.105552 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.105881 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.106220 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.106222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.106223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.106358 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.106865 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:44.106869 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:44.107062 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 07:58:44.107195 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 07:58:44.107406 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:58:44.109341 17444 heartbeater.cc:347] Connected to a master server at 127.8.51.126:46769
I20260809 07:58:44.109628 17444 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:44.110224 17444 heartbeater.cc:511] Master 127.8.51.126:46769 requested a full tablet report, sending...
I20260809 07:58:44.111697 17236 ts_manager.cc:194] Registered new tserver with Master: bc59eb2853cc40cb89817cf6ce619d30 (127.8.51.65:45177)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 07:58:44.112846 17236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:57161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:58:44.128618 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:44.235033 17449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:44.235278 17449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:44.235318 17449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:44.239266 17449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:44.239316 17449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:44.239369 17449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:44.244575 17449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:44.245501 17449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:44.246557 17449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:44.256152 17457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.256107 17454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.256107 17455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:44.256448 17449 server_base.cc:1034] running on GCE node
I20260809 07:58:44.256886 17449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:44.257521 17449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:44.258728 17449 hybrid_clock.cc:648] HybridClock initialized: now 1786262324258715 us; error 23 us; skew 500 ppm
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:44.261431 17449 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:58:44.262365 17449 webserver.cc:460] Webserver started at http://127.8.51.66:41081/ using document root <none> and password file <none>
I20260809 07:58:44.262923 17449 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:44.263011 17449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:44.263235 17449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:44.265235 17449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "ca0fe48750cc4e9ab0923abac21b8ffa"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "2ff268c465829db1a89f9c8ca14ba3b5"
server_key_iv: "5d0e934da1eb27fa8247e40f346e6ff6"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.265842 17449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "ca0fe48750cc4e9ab0923abac21b8ffa"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "2ff268c465829db1a89f9c8ca14ba3b5"
server_key_iv: "5d0e934da1eb27fa8247e40f346e6ff6"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.269515 17449 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:44.271927 17465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.273089 17449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 07:58:44.273223 17449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ca0fe48750cc4e9ab0923abac21b8ffa"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "2ff268c465829db1a89f9c8ca14ba3b5"
server_key_iv: "5d0e934da1eb27fa8247e40f346e6ff6"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.273331 17449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:44.298944 17449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:44.301720 17449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:44.301913 17449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:44.302491 17449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:44.303280 17449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:44.303349 17449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.303439 17449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:44.303483 17449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.312721 17449 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:45255
I20260809 07:58:44.312747 17588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:45255 every 8 connection(s)
I20260809 07:58:44.313607 17449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:44.315009 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17449
I20260809 07:58:44.315169 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:58:44.315543 8397 external_mini_cluster.cc:1428] Setting key 05d842ee4fa8b79b82b5b6a68b61899f
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:58:44.328639 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.315476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:45401 (local address 127.8.51.126:46769)
0809 07:58:44.315655 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:44.315660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:44.317172 (+ 1512us) server_negotiation.cc:407] Connection header received
0809 07:58:44.318123 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:44.318129 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:44.318191 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:44.318281 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:44.319627 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.320124 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.321900 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.322155 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.322234 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.325073 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:44.325077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:44.325080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:44.325110 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:44.326741 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.327219 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.327222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.327223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.327300 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.327668 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.327671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.327672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.327858 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:44.327937 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:44.328383 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 07:58:44.328500 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:58:44.329685 17591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.315953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:45401)
0809 07:58:44.316752 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:44.316805 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:44.317878 (+ 1073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:44.318417 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:44.318424 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:44.318779 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:44.319471 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.319494 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.320251 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.320257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.321764 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.321778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.322310 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.322316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.322540 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.323171 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:44.323199 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:44.324896 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:44.326851 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.326855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.326885 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.327121 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.327383 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.327385 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.327386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.327534 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.327965 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:44.327970 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:44.328184 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 07:58:44.328334 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 07:58:44.328679 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":173,"threads_started":1}
I20260809 07:58:44.330919 17589 heartbeater.cc:347] Connected to a master server at 127.8.51.126:46769
I20260809 07:58:44.331198 17589 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:44.331698 17589 heartbeater.cc:511] Master 127.8.51.126:46769 requested a full tablet report, sending...
I20260809 07:58:44.332758 17236 ts_manager.cc:194] Registered new tserver with Master: ca0fe48750cc4e9ab0923abac21b8ffa (127.8.51.66:45255)
I20260809 07:58:44.333364 17236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:45401
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:58:44.346381 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:44.456454 17595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:44.456756 17595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:44.456841 17595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:44.460805 17595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:44.460889 17595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:44.460991 17595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:44.466259 17595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:44.467365 17595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:44.468456 17595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:44.477561 17603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.477560 17601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.477654 17600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:44.477802 17595 server_base.cc:1034] running on GCE node
I20260809 07:58:44.478261 17595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:44.478892 17595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:44.480052 17595 hybrid_clock.cc:648] HybridClock initialized: now 1786262324480030 us; error 32 us; skew 500 ppm
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:44.482810 17595 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:58:44.483688 17595 webserver.cc:460] Webserver started at http://127.8.51.67:32943/ using document root <none> and password file <none>
I20260809 07:58:44.484244 17595 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:44.484334 17595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:44.484584 17595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:58:44.486671 17595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "ba9d210371ba4777b1be56007d3be3bf"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "9d6934cea0279d82de7844ce6c04ffe9"
server_key_iv: "26f6d55dec5c2084600651d6b1593f56"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.487241 17595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "ba9d210371ba4777b1be56007d3be3bf"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "9d6934cea0279d82de7844ce6c04ffe9"
server_key_iv: "26f6d55dec5c2084600651d6b1593f56"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.490833 17595 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:58:44.493388 17610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.494654 17595 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:44.494793 17595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "ba9d210371ba4777b1be56007d3be3bf"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "9d6934cea0279d82de7844ce6c04ffe9"
server_key_iv: "26f6d55dec5c2084600651d6b1593f56"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.494907 17595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:44.507458 17595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:44.510187 17595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:44.510380 17595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:44.510929 17595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:44.511713 17595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:44.511783 17595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.511852 17595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:44.511898 17595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.521106 17595 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:41555
I20260809 07:58:44.521136 17733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:41555 every 8 connection(s)
I20260809 07:58:44.522027 17595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:44.523200 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17595
I20260809 07:58:44.523341 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:58:44.523649 8397 external_mini_cluster.cc:1428] Setting key b7431ee48a0db7a8f4526ee4462ed5c3
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:58:44.535271 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.523866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:52439 (local address 127.8.51.126:46769)
0809 07:58:44.524030 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:44.524034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:44.525362 (+ 1328us) server_negotiation.cc:407] Connection header received
0809 07:58:44.526443 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:44.526446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:44.526499 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:44.526584 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:44.527660 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.528184 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.529333 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.529554 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.529730 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.532003 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:44.532006 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:44.532009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:44.532040 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:44.533217 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.533754 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.533758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.533760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.533842 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:44.534174 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:44.534179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:44.534181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:44.534355 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:44.534485 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:44.534979 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 07:58:44.535103 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:44.536027 17737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:44.524339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:52439)
0809 07:58:44.525210 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:44.525264 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:44.526254 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:44.526741 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:44.526748 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:44.527085 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:44.527523 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.527534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.528310 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.528313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.529202 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:44.529211 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:44.529762 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:44.529766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:44.529942 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:44.530436 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:44.530452 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:44.531845 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:58:44.533332 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.533338 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.533352 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.533639 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.533933 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:58:44.533937 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:58:44.533939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:58:44.534073 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:58:44.534484 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:58:44.534491 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:58:44.534743 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 07:58:44.534935 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 07:58:44.535250 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":177,"threads_started":1}
I20260809 07:58:44.537137 17735 heartbeater.cc:347] Connected to a master server at 127.8.51.126:46769
I20260809 07:58:44.537389 17735 heartbeater.cc:464] Registering TS with master...
I20260809 07:58:44.537931 17735 heartbeater.cc:511] Master 127.8.51.126:46769 requested a full tablet report, sending...
I20260809 07:58:44.538998 17236 ts_manager.cc:194] Registered new tserver with Master: ba9d210371ba4777b1be56007d3be3bf (127.8.51.67:41555)
I20260809 07:58:44.539577 17236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:52439
I20260809 07:58:44.549441 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
Entry for principal oryx/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab.
WARNING: no policy specified for oryx/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
Entry for principal oryx/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab.
WARNING: no policy specified for oryx/127.8.51.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
Entry for principal oryx/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab.
I20260809 07:58:44.620266 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17304
I20260809 07:58:44.627800 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17449
I20260809 07:58:44.634747 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17595
I20260809 07:58:44.643257 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17203
I20260809 07:58:44.650566 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:46769
--webserver_interface=127.8.51.126
--webserver_port=40513
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:46769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:58:44.759068 17745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:44.759342 17745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:44.759408 17745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:44.763082 17745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:58:44.763162 17745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:44.763200 17745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:44.763247 17745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:58:44.763283 17745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:58:44.768347 17745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:46769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:46769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=40513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:44.769430 17745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:44.770471 17745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:44.778905 17751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.778919 17750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.778925 17753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:44.779119 17745 server_base.cc:1034] running on GCE node
I20260809 07:58:44.779754 17745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:44.780879 17745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:44.782070 17745 hybrid_clock.cc:648] HybridClock initialized: now 1786262324782055 us; error 30 us; skew 500 ppm
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:44.784888 17745 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:58:44.785818 17745 webserver.cc:460] Webserver started at http://127.8.51.126:40513/ using document root <none> and password file <none>
I20260809 07:58:44.786446 17745 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:44.786558 17745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:44.790467 17745 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 07:58:44.792579 17762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.793845 17745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 07:58:44.793979 17745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "87b4ebf856d046549d77a4365ab3ef1e"
format_stamp: "Formatted at 2026-08-09 07:58:43 on dist-test-slave-njxd"
server_key: "0287300a8e7cb877c20c1b021b1aac8a"
server_key_iv: "8ad62ca4995ee36114c29abe866124e0"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.794548 17745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:44.808545 17745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:44.811362 17745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:44.811595 17745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:44.818851 17745 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:46769
I20260809 07:58:44.818866 17817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:46769 every 8 connection(s)
I20260809 07:58:44.819911 17745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:58:44.824067 17818 sys_catalog.cc:263] Verifying existing consensus state
I20260809 07:58:44.825681 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Bootstrap starting.
I20260809 07:58:44.827042 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17745
I20260809 07:58:44.827525 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:45177
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:46769
--webserver_port=40911
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 07:58:44.846787 17818 log.cc:824] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Log is configured to *not* fsync() on all Append() calls
I20260809 07:58:44.853662 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 07:58:44.854027 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Bootstrap complete.
I20260809 07:58:44.858465 17818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:44.858892 17818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b4ebf856d046549d77a4365ab3ef1e, State: Initialized, Role: FOLLOWER
I20260809 07:58:44.859390 17818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:44.859534 17818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:58:44.859619 17818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:58:44.859740 17818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 1 FOLLOWER]: Advancing to term 2
I20260809 07:58:44.861765 17818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:44.862103 17818 leader_election.cc:302] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b4ebf856d046549d77a4365ab3ef1e; no voters:
I20260809 07:58:44.862460 17818 leader_election.cc:288] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 07:58:44.862553 17822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 07:58:44.862747 17822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [term 2 LEADER]: Becoming Leader. State: Replica: 87b4ebf856d046549d77a4365ab3ef1e, State: Running, Role: LEADER
I20260809 07:58:44.863054 17822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } }
I20260809 07:58:44.863744 17818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:58:44.864483 17823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "87b4ebf856d046549d77a4365ab3ef1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } } }
I20260809 07:58:44.864629 17823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:44.865152 17824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b4ebf856d046549d77a4365ab3ef1e. Latest consensus state: current_term: 2 leader_uuid: "87b4ebf856d046549d77a4365ab3ef1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4ebf856d046549d77a4365ab3ef1e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 46769 } } }
I20260809 07:58:44.865298 17824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e [sys.catalog]: This master's current role is: LEADER
I20260809 07:58:44.865491 17828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:58:44.868554 17828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:58:44.869202 17828 catalog_manager.cc:1259] Loaded cluster ID: 4e98d7f55c4f4fb29fa713cee9f610f7
I20260809 07:58:44.869264 17828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:58:44.871693 17828 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:58:44.872336 17828 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87b4ebf856d046549d77a4365ab3ef1e: Loaded TSK: 0
I20260809 07:58:44.873485 17828 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 07:58:44.948475 17820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:44.948791 17820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:44.948869 17820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:44.952893 17820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:44.952982 17820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:44.953088 17820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:58:44.958328 17820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.65.keytab
--principal=oryx/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:45177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=40911
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:44.959336 17820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:44.960328 17820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:44.971154 17847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.971144 17848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:44.971262 17851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:44.971583 17820 server_base.cc:1034] running on GCE node
I20260809 07:58:44.971988 17820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:44.972687 17820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:44.973858 17820 hybrid_clock.cc:648] HybridClock initialized: now 1786262324973832 us; error 41 us; skew 500 ppm
Aug 09 07:58:44 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262324, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:44.977165 17820 init.cc:377] Logged in from keytab as oryx/127.8.51.65@KRBTEST.COM (short username oryx)
I20260809 07:58:44.978277 17820 webserver.cc:460] Webserver started at http://127.8.51.65:40911/ using document root <none> and password file <none>
I20260809 07:58:44.978968 17820 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:44.979082 17820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:44.983982 17820 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 07:58:44.986462 17858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:44.987890 17820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 07:58:44.987993 17820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "bc59eb2853cc40cb89817cf6ce619d30"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "663fe3706fc43f3ba8409fdddda73d5e"
server_key_iv: "2b91680cf364a9c276c8867f3c69583a"
server_key_version: "encryptionkey@0"
I20260809 07:58:44.988601 17820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:45.006623 17820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:45.009855 17820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:45.010027 17820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:45.010664 17820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:45.011571 17820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:45.011649 17820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.011696 17820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:45.011729 17820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.020661 17820 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:45177
I20260809 07:58:45.020716 17980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:45177 every 8 connection(s)
I20260809 07:58:45.021759 17820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:58:45.025563 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17820
I20260809 07:58:45.026116 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:45255
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:46769
--webserver_port=41081
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.037645 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.024348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:36951)
0809 07:58:45.025771 (+ 1423us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.025828 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.027127 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.028430 (+ 1303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.028436 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.028791 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.029259 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.029273 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.030646 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.030653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.032191 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.032206 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.032986 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.032993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.033226 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.033931 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.033958 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.036670 (+ 2712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1156,"thread_start_us":156,"threads_started":1}
W20260809 07:58:45.037639 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.024103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:36951 (local address 127.8.51.126:46769)
0809 07:58:45.024672 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.024694 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.025959 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 07:58:45.027548 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.027576 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.027967 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.028362 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.029424 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.030471 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.032325 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.032796 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.032915 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.036885 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:36951: BlockingRecv error: recv got EOF from 127.8.51.65:36951 (error 108)
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":115,"threads_started":1}
W20260809 07:58:45.038368 17981 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:46769 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.51.126:46769: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.044086 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.038818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:36149)
0809 07:58:45.038946 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.038962 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.039037 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.039283 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.039286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.039448 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.039532 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.039536 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.040307 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.040312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.040840 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.040847 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.041358 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.041361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.041449 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.041998 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.042010 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.043930 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 07:58:45.044163 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.038928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:36149 (local address 127.8.51.126:46769)
0809 07:58:45.039049 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.039054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.039082 (+ 28us) server_negotiation.cc:407] Connection header received
0809 07:58:45.039121 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.039124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.039171 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.039270 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.039660 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.040199 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.040952 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.041247 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.041354 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.044051 (+ 2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:36149: BlockingRecv error: recv got EOF from 127.8.51.65:36149 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.049973 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.044791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:46019)
0809 07:58:45.044897 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.044913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.044982 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.045204 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.045206 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.045325 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.045394 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.045398 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.046400 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.046403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.046918 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.046925 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.047509 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.047512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.047581 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.048060 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.048073 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.049878 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 07:58:45.050153 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.044867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:46019 (local address 127.8.51.126:46769)
0809 07:58:45.044979 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.044983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.044997 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:45.045058 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.045061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.045104 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.045182 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.045495 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.046297 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.047023 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.047403 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.047511 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.050044 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:46019: BlockingRecv error: recv got EOF from 127.8.51.65:46019 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 07:58:45.050205 17981 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 07:58:45.144181 17985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:45.144418 17985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:45.144459 17985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:45.148428 17985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:45.148481 17985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:45.148535 17985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:58:45.153473 17985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.66.keytab
--principal=oryx/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:45255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=41081
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:45.154497 17985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:45.155529 17985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:45.165113 17991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:45.165201 17990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:45.165206 17993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:45.165495 17985 server_base.cc:1034] running on GCE node
I20260809 07:58:45.165944 17985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:45.166599 17985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:45.167781 17985 hybrid_clock.cc:648] HybridClock initialized: now 1786262325167770 us; error 24 us; skew 500 ppm
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262325, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:45.170500 17985 init.cc:377] Logged in from keytab as oryx/127.8.51.66@KRBTEST.COM (short username oryx)
I20260809 07:58:45.171339 17985 webserver.cc:460] Webserver started at http://127.8.51.66:41081/ using document root <none> and password file <none>
I20260809 07:58:45.171895 17985 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:45.171994 17985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:45.175942 17985 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 07:58:45.178001 18000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.179195 17985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:58:45.179327 17985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ca0fe48750cc4e9ab0923abac21b8ffa"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "2ff268c465829db1a89f9c8ca14ba3b5"
server_key_iv: "5d0e934da1eb27fa8247e40f346e6ff6"
server_key_version: "encryptionkey@0"
I20260809 07:58:45.179850 17985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:45.197901 17985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:45.200800 17985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:45.200999 17985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:45.201557 17985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:45.202419 17985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:45.202488 17985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.202556 17985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:45.202605 17985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.211586 17985 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:45255
I20260809 07:58:45.211608 18127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:45255 every 8 connection(s)
I20260809 07:58:45.212582 17985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:58:45.214179 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 17985
I20260809 07:58:45.214718 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:41555
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:46769
--webserver_port=32943
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 07:58:45.224920 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.214612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:35651 (local address 127.8.51.126:46769)
0809 07:58:45.214754 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.214757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.216007 (+ 1250us) server_negotiation.cc:407] Connection header received
0809 07:58:45.216953 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.216957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.217024 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.217139 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.218420 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.219283 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.220556 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.220987 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.221124 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.224814 (+ 3690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:35651: BlockingRecv error: recv got EOF from 127.8.51.66:35651 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 07:58:45.225875 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.215129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:35651)
0809 07:58:45.215842 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.215883 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.216732 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.217321 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.217328 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.217767 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.218256 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.218269 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.219428 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.219431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.220415 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.220426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.221149 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.221152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.221300 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.221962 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.221978 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.224701 (+ 2723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":152,"threads_started":1}
W20260809 07:58:45.226384 18128 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:46769 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.51.126:46769: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.231739 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.226813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:54383)
0809 07:58:45.226926 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.226942 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.227038 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.227300 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.227303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.227464 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.227548 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.227553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.228258 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.228262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.228800 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.228807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.229243 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.229247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.229335 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.229844 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.229855 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.231619 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 07:58:45.231997 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.226945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:54383 (local address 127.8.51.126:46769)
0809 07:58:45.227100 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.227107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.227128 (+ 21us) server_negotiation.cc:407] Connection header received
0809 07:58:45.227161 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.227163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.227198 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.227285 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.227669 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.228146 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.228920 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.229131 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.229242 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.231738 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:54383: BlockingRecv error: recv got EOF from 127.8.51.66:54383 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.237344 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.232266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:42029)
0809 07:58:45.232483 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.232495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.232564 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.232782 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.232784 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.232904 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.232967 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.232971 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.233976 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.233978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.234467 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.234475 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.235024 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.235026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.235080 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.235523 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.235533 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.237247 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 07:58:45.237532 18128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 07:58:45.237737 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.232323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:42029 (local address 127.8.51.126:46769)
0809 07:58:45.232434 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.232437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.232558 (+ 121us) server_negotiation.cc:407] Connection header received
0809 07:58:45.232641 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.232644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.232687 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.232760 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.233064 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.233875 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.234589 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.234926 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.235018 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.237404 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:42029: BlockingRecv error: recv got EOF from 127.8.51.66:42029 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260809 07:58:45.330174 18131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:58:45.330412 18131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:58:45.330452 18131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:58:45.334286 18131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:58:45.334336 18131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:58:45.334389 18131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:58:45.339282 18131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/krb5kdc/oryx_127.8.51.67.keytab
--principal=oryx/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:41555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=32943
--tserver_master_addrs=127.8.51.126:46769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:58:45.340164 18131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:58:45.341079 18131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:58:45.350203 18137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:45.350261 18131 server_base.cc:1034] running on GCE node
W20260809 07:58:45.350215 18136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:58:45.350215 18139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:58:45.350795 18131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:58:45.351397 18131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:58:45.352566 18131 hybrid_clock.cc:648] HybridClock initialized: now 1786262325352549 us; error 44 us; skew 500 ppm
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262325, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:58:45.355276 18131 init.cc:377] Logged in from keytab as oryx/127.8.51.67@KRBTEST.COM (short username oryx)
I20260809 07:58:45.356093 18131 webserver.cc:460] Webserver started at http://127.8.51.67:32943/ using document root <none> and password file <none>
I20260809 07:58:45.356590 18131 fs_manager.cc:359] Metadata directory not provided
I20260809 07:58:45.356662 18131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:58:45.360303 18131 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:45.362360 18146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.363510 18131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:58:45.363639 18131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "ba9d210371ba4777b1be56007d3be3bf"
format_stamp: "Formatted at 2026-08-09 07:58:44 on dist-test-slave-njxd"
server_key: "9d6934cea0279d82de7844ce6c04ffe9"
server_key_iv: "26f6d55dec5c2084600651d6b1593f56"
server_key_version: "encryptionkey@0"
I20260809 07:58:45.364218 18131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:58:45.385371 18131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:58:45.388123 18131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:58:45.388324 18131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:58:45.388901 18131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:58:45.389747 18131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:58:45.389814 18131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.389885 18131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:58:45.389927 18131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:58:45.399362 18131 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:41555
I20260809 07:58:45.399390 18269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:41555 every 8 connection(s)
I20260809 07:58:45.400359 18131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:58:45.403189 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18131
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 07:58:45.411270 17983 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.402114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:46707 (local address 127.8.51.126:46769)
0809 07:58:45.402286 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.402291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.403368 (+ 1077us) server_negotiation.cc:407] Connection header received
0809 07:58:45.404488 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.404491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.404545 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.404652 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.405888 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.406402 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.407532 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.407743 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.407844 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.411153 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:46707: BlockingRecv error: recv got EOF from 127.8.51.67:46707 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 07:58:45.411957 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.402508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:46707)
0809 07:58:45.403132 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.403181 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.404268 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.404846 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.404853 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.405199 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.405732 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.405748 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.406526 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.406529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.407402 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.407411 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.407895 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.407899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.408071 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.408589 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.408603 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.411055 (+ 2452us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":114,"threads_started":1}
W20260809 07:58:45.412559 18270 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:46769 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.51.126:46769: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
I20260809 07:58:45.412703 18274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.404149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46106 (local address 127.8.51.126:46769)
0809 07:58:45.404384 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.404387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.404405 (+ 18us) server_negotiation.cc:407] Connection header received
0809 07:58:45.404443 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.404446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.404483 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.404581 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.405374 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.405965 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.406870 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.407105 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.407216 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.408699 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:58:45.408704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:58:45.408717 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:58:45.408742 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:58:45.410678 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:45.411104 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:45.411109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:45.411113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:45.411229 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:58:45.411495 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:58:45.411499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:58:45.411501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:58:45.411834 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:58:45.412024 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 07:58:45.412322 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 07:58:45.412544 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.417938 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.413148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:33651)
0809 07:58:45.413295 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.413309 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.413378 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.413615 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.413617 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.413783 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.413866 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.413872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.414639 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.414642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.415257 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.415266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.415730 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.415733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.415798 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.416239 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.416251 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.417856 (+ 1605us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89}
W20260809 07:58:45.418113 18274 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.413215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:33651 (local address 127.8.51.126:46769)
0809 07:58:45.413324 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.413326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.413340 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:45.413456 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.413458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.413489 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.413550 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.413983 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.414520 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.415397 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.415634 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.415713 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.417996 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:33651: BlockingRecv error: recv got EOF from 127.8.51.67:33651 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:45 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:45.422775 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:45.418414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:50039)
0809 07:58:45.418523 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:45.418536 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:45.418607 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:45.418819 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:45.418821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:45.418962 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:45.419020 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.419025 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.419681 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.419684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.420162 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:45.420169 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.420592 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.420596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:45.420684 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.421096 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:45.421107 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:45.422649 (+ 1542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 07:58:45.422833 18274 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:45.418497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:50039 (local address 127.8.51.126:46769)
0809 07:58:45.418623 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:45.418628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:45.418643 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:45.418683 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:45.418687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:45.418727 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:45.418805 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:45.419128 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.419572 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.420289 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:45.420484 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:45.420581 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:45.422738 (+ 2157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:50039: BlockingRecv error: recv got EOF from 127.8.51.67:50039 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 07:58:45.422997 18270 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:46.056288 18275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:46.050812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:46889)
0809 07:58:46.051113 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:46.051127 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:46.051216 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:46.051459 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:46.051461 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:46.051649 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:46.051749 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.051754 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.052547 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.052551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.053137 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.053146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.053643 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.053647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.053713 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.054307 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:46.054319 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:46.056159 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":72,"threads_started":1}
W20260809 07:58:46.056429 18276 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:46.050862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:46889 (local address 127.8.51.126:46769)
0809 07:58:46.051155 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:46.051159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:46.051173 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:58:46.051301 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:46.051303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:46.051345 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:46.051421 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:46.051843 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.052370 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.053248 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.053464 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.053536 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.056297 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:46889: BlockingRecv error: recv got EOF from 127.8.51.65:46889 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":126,"threads_started":1}
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:46.243291 18277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:46.238193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:59045)
0809 07:58:46.238482 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:46.238496 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:46.238598 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:46.238835 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:46.238838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:46.239017 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:46.239119 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.239124 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.239792 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.239795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.240342 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.240350 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.240723 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.240725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.240778 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.241340 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:46.241352 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:46.243152 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
W20260809 07:58:46.243446 18276 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:46.238262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:59045 (local address 127.8.51.126:46769)
0809 07:58:46.238411 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:46.238417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:46.238568 (+ 151us) server_negotiation.cc:407] Connection header received
0809 07:58:46.238681 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:46.238683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:46.238729 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:46.238787 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:46.239213 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.239706 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.240448 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.240637 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.240704 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.243304 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:59045: BlockingRecv error: recv got EOF from 127.8.51.66:59045 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:46 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:46.429476 18278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:46.423583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:57641)
0809 07:58:46.423889 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:46.423903 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:46.424047 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:46.424404 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:46.424409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:46.424687 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:46.424871 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.424880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.425758 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.425761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.426351 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:46.426359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.426752 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.426755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:46.426823 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.427349 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:46.427361 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:46.429302 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":120,"threads_started":1}
W20260809 07:58:46.429529 18276 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:46.423633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:57641 (local address 127.8.51.126:46769)
0809 07:58:46.423779 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:46.423783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:46.423977 (+ 194us) server_negotiation.cc:407] Connection header received
0809 07:58:46.424185 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:46.424189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:46.424264 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:46.424379 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:46.425007 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.425625 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.426451 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:46.426660 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:46.426734 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:46.429418 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:57641: BlockingRecv error: recv got EOF from 127.8.51.67:57641 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:47.062692 18279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:47.057219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:55507)
0809 07:58:47.057502 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:47.057515 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:47.057695 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:47.057951 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:47.057953 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:47.058147 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:47.058248 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.058254 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.058974 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.058976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.059521 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.059528 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.059950 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.059952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.060012 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.060612 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:47.060624 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:47.062539 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":95,"threads_started":1}
W20260809 07:58:47.062880 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:47.057272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:55507 (local address 127.8.51.126:46769)
0809 07:58:47.057535 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:47.057539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:47.057664 (+ 125us) server_negotiation.cc:407] Connection header received
0809 07:58:47.057786 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:47.057788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:47.057834 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:47.057918 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:47.058348 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.058881 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.059636 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.059855 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.059929 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.062696 (+ 2767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:55507: BlockingRecv error: recv got EOF from 127.8.51.65:55507 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":66,"threads_started":1}
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:47.249840 18281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:47.244297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:47637)
0809 07:58:47.244587 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:47.244607 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:47.244708 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:47.244930 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:47.244932 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:47.245131 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:47.245227 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.245232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.245972 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.245975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.246535 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.246543 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.246993 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.246996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.247071 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.247676 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:47.247689 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:47.249689 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":117,"threads_started":1}
W20260809 07:58:47.250078 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:47.244333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:47637 (local address 127.8.51.126:46769)
0809 07:58:47.244481 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:47.244485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:47.244678 (+ 193us) server_negotiation.cc:407] Connection header received
0809 07:58:47.244786 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:47.244789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:47.244833 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:47.244894 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:47.245325 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.245883 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.246673 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.246890 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.246970 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.249918 (+ 2948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:47637: BlockingRecv error: recv got EOF from 127.8.51.66:47637 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:47 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:47.436157 18282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:47.430632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:42771)
0809 07:58:47.430951 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:47.430965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:47.431074 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:47.431329 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:47.431331 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:47.431520 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:47.431619 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.431624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.432350 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.432353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.432916 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:47.432924 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.433339 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.433342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:47.433403 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.433965 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:47.433977 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:47.435970 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":93,"threads_started":1}
W20260809 07:58:47.436350 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:47.430836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:42771 (local address 127.8.51.126:46769)
0809 07:58:47.430979 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:47.430982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:47.431021 (+ 39us) server_negotiation.cc:407] Connection header received
0809 07:58:47.431164 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:47.431166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:47.431212 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:47.431283 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:47.431725 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.432247 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.433020 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:47.433238 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:47.433325 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:47.436185 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:42771: BlockingRecv error: recv got EOF from 127.8.51.67:42771 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:48.076371 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:48.063495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:53391)
0809 07:58:48.063763 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:48.063777 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:48.063869 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:48.064195 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:48.064197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:48.064378 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:48.064475 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.064479 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.065364 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.065366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.066037 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.066046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.066479 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.066481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.066541 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.074206 (+ 7665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:48.074218 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:48.076234 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":89,"threads_started":1}
W20260809 07:58:48.076568 18284 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:48.063561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:53391 (local address 127.8.51.126:46769)
0809 07:58:48.063839 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:48.063842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:48.063855 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:48.063986 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:48.063988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:48.064029 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:48.064159 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:48.064611 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.065270 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.066156 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.066390 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.066460 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.076387 (+ 9927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:53391: BlockingRecv error: recv got EOF from 127.8.51.65:53391 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":113,"threads_started":1}
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:48.256240 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:48.250647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:49971)
0809 07:58:48.250933 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:48.250947 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:48.251040 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:48.251276 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:48.251278 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:48.251460 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:48.251552 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.251557 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.252259 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.252261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.252866 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.252873 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.253292 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.253295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.253351 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.253876 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:48.253887 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:48.256049 (+ 2162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":118,"threads_started":1}
W20260809 07:58:48.256328 18284 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:48.250739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:49971 (local address 127.8.51.126:46769)
0809 07:58:48.250880 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:48.250884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:48.251013 (+ 129us) server_negotiation.cc:407] Connection header received
0809 07:58:48.251122 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:48.251124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:48.251168 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:48.251237 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:48.251650 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.252168 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.252969 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.253197 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.253273 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.256195 (+ 2922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:49971: BlockingRecv error: recv got EOF from 127.8.51.66:49971 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:48 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:48.442678 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:48.437013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:41773)
0809 07:58:48.437298 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:48.437312 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:48.437421 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:48.437775 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:48.437781 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:48.437977 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:48.438087 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.438093 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.438818 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.438820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.439396 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:48.439403 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.439807 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.439810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:48.439872 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.440458 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:48.440475 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:48.442506 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":155,"threads_started":1}
W20260809 07:58:48.442761 18284 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:48.437113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:41773 (local address 127.8.51.126:46769)
0809 07:58:48.437316 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:48.437321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:48.437394 (+ 73us) server_negotiation.cc:407] Connection header received
0809 07:58:48.437507 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:48.437509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:48.437556 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:48.437672 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:48.438196 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.438717 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.439497 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:48.439711 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:48.439784 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:48.442644 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:41773: BlockingRecv error: recv got EOF from 127.8.51.67:41773 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:49.082231 18287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:49.077164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:45577)
0809 07:58:49.077460 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:49.077471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:49.077562 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:49.077790 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:49.077791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:49.077961 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:49.078054 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.078059 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.078745 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.078748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.079277 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.079285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.079667 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.079669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.079731 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.080258 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:49.080278 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:49.082119 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":94,"threads_started":1}
W20260809 07:58:49.082384 18288 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:49.077213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:45577 (local address 127.8.51.126:46769)
0809 07:58:49.077449 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:49.077452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:49.077516 (+ 64us) server_negotiation.cc:407] Connection header received
0809 07:58:49.077660 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:49.077662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:49.077704 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:49.077775 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:49.078151 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.078653 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.079369 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.079575 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.079647 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.082249 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:45577: BlockingRecv error: recv got EOF from 127.8.51.65:45577 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:49.262850 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:49.257147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:53883)
0809 07:58:49.257477 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:49.257490 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:49.257643 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:49.257936 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:49.257939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:49.258162 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:49.258257 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.258263 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.259060 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.259065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.259617 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.259625 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.260095 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.260098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.260189 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.260750 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:49.260761 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:49.262740 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":84,"threads_started":1}
W20260809 07:58:49.263036 18288 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:49.257205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53883 (local address 127.8.51.126:46769)
0809 07:58:49.257346 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:49.257351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:49.257604 (+ 253us) server_negotiation.cc:407] Connection header received
0809 07:58:49.257758 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:49.257762 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:49.257817 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:49.257906 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:49.258384 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.258945 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.259741 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.259967 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.260073 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.262879 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:53883: BlockingRecv error: recv got EOF from 127.8.51.66:53883 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:49 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:49.448876 18290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:49.443653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:49003)
0809 07:58:49.443931 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:49.443945 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:49.444051 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:49.444270 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:49.444272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:49.444464 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:49.444558 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.444563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.445278 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.445280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.445895 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:49.445903 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.446310 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.446313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:49.446371 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.446957 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:49.446969 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:49.448765 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
W20260809 07:58:49.449007 18288 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:49.443695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:49003 (local address 127.8.51.126:46769)
0809 07:58:49.443853 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:49.443857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:49.444016 (+ 159us) server_negotiation.cc:407] Connection header received
0809 07:58:49.444117 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:49.444119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:49.444165 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:49.444234 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:49.444662 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.445187 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.445996 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:49.446219 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:49.446288 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:49.448893 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:49003: BlockingRecv error: recv got EOF from 127.8.51.67:49003 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:50.088629 18291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:50.083022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:41827)
0809 07:58:50.083327 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:50.083345 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:50.083444 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:50.083673 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:50.083675 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:50.083911 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:50.084045 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.084052 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.084816 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.084819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.085414 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.085422 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.085913 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.085915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.085978 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.086595 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:50.086608 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:50.088487 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":101,"threads_started":1}
W20260809 07:58:50.088752 18292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:50.083181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:41827 (local address 127.8.51.126:46769)
0809 07:58:50.083427 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:50.083431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:50.083444 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:50.083524 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:50.083526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:50.083567 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:50.083634 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:50.084168 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.084694 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.085520 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.085813 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.085892 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.088625 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:41827: BlockingRecv error: recv got EOF from 127.8.51.65:41827 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":90,"threads_started":1}
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:50.270092 18293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:50.263677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:58631)
0809 07:58:50.264155 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:50.264169 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:50.264337 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:50.264653 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:50.264656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:50.264921 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:50.265040 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.265048 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.265996 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.266001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.266589 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.266597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.267063 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.267067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.267151 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.267741 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:50.267754 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:50.269918 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":123,"threads_started":1}
W20260809 07:58:50.270174 18292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:50.263861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:58631 (local address 127.8.51.126:46769)
0809 07:58:50.264014 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:50.264018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:50.264254 (+ 236us) server_negotiation.cc:407] Connection header received
0809 07:58:50.264444 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:50.264447 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:50.264499 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:50.264606 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:50.265185 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.265891 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.266725 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.266947 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.267049 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.270047 (+ 2998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:58631: BlockingRecv error: recv got EOF from 127.8.51.66:58631 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:50 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:50.456125 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:50.449954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:49651)
0809 07:58:50.450312 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:50.450328 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:50.450473 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:50.450816 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:50.450819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:50.451068 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:50.451167 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.451174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.452017 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.452022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.452706 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:50.452715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.453245 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.453249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:50.453344 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.453869 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:50.453881 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:50.455919 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":127,"threads_started":1}
W20260809 07:58:50.456190 18292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:50.450003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:49651 (local address 127.8.51.126:46769)
0809 07:58:50.450171 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:50.450176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:50.450422 (+ 246us) server_negotiation.cc:407] Connection header received
0809 07:58:50.450631 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:50.450634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:50.450689 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:50.450790 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:50.451311 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.451896 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.452846 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:50.453118 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:50.453240 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:50.456062 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:49651: BlockingRecv error: recv got EOF from 127.8.51.67:49651 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:51.094980 18295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:51.089492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:38443)
0809 07:58:51.089818 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:51.089840 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:51.089938 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:51.090188 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:51.090190 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:51.090370 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:51.090464 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.090469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.091167 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.091169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.091718 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.091724 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.092111 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.092113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.092180 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.092684 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:51.092694 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:51.094812 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":153,"threads_started":1}
W20260809 07:58:51.095144 18296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:51.089558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38443 (local address 127.8.51.126:46769)
0809 07:58:51.089824 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:51.089827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:51.089890 (+ 63us) server_negotiation.cc:407] Connection header received
0809 07:58:51.090017 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:51.090019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:51.090063 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:51.090148 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:51.090555 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.091064 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.091809 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.092018 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.092098 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.094991 (+ 2893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:38443: BlockingRecv error: recv got EOF from 127.8.51.65:38443 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":85,"threads_started":1}
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:51.276070 18297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:51.270936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:43665)
0809 07:58:51.271252 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:51.271266 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:51.271367 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:51.271584 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:51.271586 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:51.271779 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:51.271873 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.271878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.272596 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.272598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.273120 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.273127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.273525 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.273527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.273614 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.274083 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:51.274094 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:51.275960 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":121,"threads_started":1}
W20260809 07:58:51.276232 18296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:51.270989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:43665 (local address 127.8.51.126:46769)
0809 07:58:51.271168 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:51.271173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:51.271340 (+ 167us) server_negotiation.cc:407] Connection header received
0809 07:58:51.271434 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:51.271437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:51.271481 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:51.271549 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:51.271969 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.272505 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.273223 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.273429 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.273499 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.276103 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:43665: BlockingRecv error: recv got EOF from 127.8.51.66:43665 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:51 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:51.462155 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:51.457008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:39951)
0809 07:58:51.457335 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:51.457349 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:51.457446 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:51.457706 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:51.457708 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:51.457940 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:51.458034 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.458039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.458747 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.458749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.459271 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:51.459278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.459668 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.459670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:51.459728 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.460190 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:51.460200 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:51.462037 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":146,"threads_started":1}
W20260809 07:58:51.462297 18296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:51.457057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:39951 (local address 127.8.51.126:46769)
0809 07:58:51.457229 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:51.457235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:51.457421 (+ 186us) server_negotiation.cc:407] Connection header received
0809 07:58:51.457525 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:51.457527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:51.457606 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:51.457671 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:51.458137 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.458658 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.459365 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:51.459568 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:51.459650 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:51.462166 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:39951: BlockingRecv error: recv got EOF from 127.8.51.67:39951 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:52.101778 18299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:52.095867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:45945)
0809 07:58:52.096205 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:52.096218 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:52.096316 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:52.096564 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:52.096567 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:52.096771 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:52.096895 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.096903 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.098051 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.098055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.098667 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.098677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.099162 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.099168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.099261 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.099765 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:52.099776 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:52.101663 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":113,"threads_started":1}
W20260809 07:58:52.101962 18300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:52.095947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:45945 (local address 127.8.51.126:46769)
0809 07:58:52.096196 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:52.096199 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:52.096286 (+ 87us) server_negotiation.cc:407] Connection header received
0809 07:58:52.096382 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:52.096384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:52.096427 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:52.096507 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:52.097043 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.097910 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.098778 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.099028 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.099157 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.101792 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:45945: BlockingRecv error: recv got EOF from 127.8.51.65:45945 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":93,"threads_started":1}
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:52.282769 18302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:52.277032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:38781)
0809 07:58:52.277350 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:52.277363 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:52.277498 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:52.277799 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:52.277802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:52.278028 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:52.278116 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.278121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.278883 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.278889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.279457 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.279464 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.279918 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.279921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.280006 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.280603 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:52.280615 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:52.282658 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":89,"threads_started":1}
W20260809 07:58:52.282958 18300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:52.277078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:38781 (local address 127.8.51.126:46769)
0809 07:58:52.277252 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:52.277257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:52.277443 (+ 186us) server_negotiation.cc:407] Connection header received
0809 07:58:52.277623 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:52.277626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:52.277687 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:52.277778 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:52.278237 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.278771 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.279577 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.279805 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.279914 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.282787 (+ 2873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:38781: BlockingRecv error: recv got EOF from 127.8.51.66:38781 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:52 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:52.469524 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:52.463283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:53979)
0809 07:58:52.463640 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:52.463654 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:52.463753 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:52.463985 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:52.463987 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:52.464261 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:52.464375 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.464381 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.465205 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.465207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.465916 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:52.465925 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.466435 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.466439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:52.466538 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.467113 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:52.467127 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:52.469348 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":126,"threads_started":1}
W20260809 07:58:52.469573 18300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:52.463371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:53979 (local address 127.8.51.126:46769)
0809 07:58:52.463512 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:52.463519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:52.463721 (+ 202us) server_negotiation.cc:407] Connection header received
0809 07:58:52.463830 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:52.463832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:52.463878 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:52.463950 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:52.464460 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.465088 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.466017 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:52.466294 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:52.466411 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:52.469468 (+ 3057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:53979: BlockingRecv error: recv got EOF from 127.8.51.67:53979 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:53.111164 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:53.102500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:47003)
0809 07:58:53.102854 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:53.102868 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:53.102959 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:53.103314 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:53.103316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:53.103505 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:53.103609 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.103614 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.104343 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.104345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.104878 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.104885 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.105293 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.105295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.105374 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.108688 (+ 3314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:53.108701 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:53.110948 (+ 2247us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":109,"threads_started":1}
W20260809 07:58:53.111806 18305 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:53.102862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:47003 (local address 127.8.51.126:46769)
0809 07:58:53.103084 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:53.103087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:53.103099 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:53.103144 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:53.103146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:53.103187 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:53.103264 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:53.103715 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.104253 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.104972 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.105189 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.105260 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.111664 (+ 6404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:47003: BlockingRecv error: recv got EOF from 127.8.51.65:47003 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":80,"threads_started":1}
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:53.289529 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:53.283569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:46031)
0809 07:58:53.283876 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:53.283889 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:53.283989 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:53.284252 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:53.284254 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:53.284454 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:53.284549 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.284554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.285560 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.285564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.286434 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.286445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.286875 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.286877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.286939 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.287501 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:53.287512 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:53.289416 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":95,"threads_started":1}
W20260809 07:58:53.289726 18305 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:53.283635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:46031 (local address 127.8.51.126:46769)
0809 07:58:53.283805 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:53.283812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:53.283962 (+ 150us) server_negotiation.cc:407] Connection header received
0809 07:58:53.284070 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:53.284073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:53.284117 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:53.284216 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:53.284661 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.285410 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.286548 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.286778 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.286858 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.289539 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:46031: BlockingRecv error: recv got EOF from 127.8.51.66:46031 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:53 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:53.475696 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:53.470268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:49997)
0809 07:58:53.470537 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:53.470550 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:53.470643 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:53.470854 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:53.470856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:53.471028 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:53.471116 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.471120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.471802 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.471804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.472340 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:53.472347 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.472840 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.472845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:53.472956 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.473652 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:53.473669 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:53.475579 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":115,"threads_started":1}
W20260809 07:58:53.475871 18305 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:53.470300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:49997 (local address 127.8.51.126:46769)
0809 07:58:53.470439 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:53.470443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:53.470617 (+ 174us) server_negotiation.cc:407] Connection header received
0809 07:58:53.470717 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:53.470719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:53.470762 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:53.470824 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:53.471207 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.471713 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.472429 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:53.472689 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:53.472814 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:53.475714 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:49997: BlockingRecv error: recv got EOF from 127.8.51.67:49997 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:54.117822 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:54.112164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:42261)
0809 07:58:54.112470 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:54.112483 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:54.112572 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:54.112820 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:54.112822 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:54.113020 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:54.113116 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.113121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.113910 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.113912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.114472 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.114479 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.114908 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.114911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.114969 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.115441 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:54.115452 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:54.117707 (+ 2255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":96,"threads_started":1}
W20260809 07:58:54.117966 18309 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:54.112314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:42261 (local address 127.8.51.126:46769)
0809 07:58:54.112540 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:54.112543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:54.112556 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:54.112664 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:54.112666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:54.112710 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:54.112788 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:54.113224 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.113820 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.114598 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.114816 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.114890 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.117833 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:42261: BlockingRecv error: recv got EOF from 127.8.51.65:42261 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":58,"threads_started":1}
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:54.295610 18310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:54.290289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:36883)
0809 07:58:54.290550 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:54.290563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:54.290661 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:54.290880 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:54.290882 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:54.291065 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:54.291168 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.291174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.291847 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.291849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.292450 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.292460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.292917 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.292920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.292979 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.293516 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:54.293529 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:54.295492 (+ 1963us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
W20260809 07:58:54.295801 18309 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:54.290331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36883 (local address 127.8.51.126:46769)
0809 07:58:54.290465 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:54.290468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:54.290634 (+ 166us) server_negotiation.cc:407] Connection header received
0809 07:58:54.290734 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:54.290736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:54.290780 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:54.290846 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:54.291257 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.291760 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.292547 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.292821 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.292901 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.295644 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:36883: BlockingRecv error: recv got EOF from 127.8.51.66:36883 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:54 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:54.481674 18311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:54.476467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:37161)
0809 07:58:54.476748 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:54.476762 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:54.476875 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:54.477100 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:54.477102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:54.477287 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:54.477380 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.477385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.478094 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.478097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.478634 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:54.478642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.479043 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.479046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:54.479111 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.479584 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:54.479595 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:54.481483 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
W20260809 07:58:54.481829 18309 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:54.476540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37161 (local address 127.8.51.126:46769)
0809 07:58:54.476697 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:54.476701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:54.476843 (+ 142us) server_negotiation.cc:407] Connection header received
0809 07:58:54.476948 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:54.476950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:54.476994 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:54.477058 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:54.477478 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.477996 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.478732 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:54.478935 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:54.479005 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:54.481681 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:37161: BlockingRecv error: recv got EOF from 127.8.51.67:37161 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:55.123953 18312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:55.118719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:39577)
0809 07:58:55.118997 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:55.119012 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:55.119094 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:55.119356 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:55.119358 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:55.119576 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:55.119668 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.119673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.120324 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.120326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.120846 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.120852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.121310 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.121312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.121373 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.121855 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:55.121865 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:55.123812 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
W20260809 07:58:55.124120 18313 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:55.118801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:39577 (local address 127.8.51.126:46769)
0809 07:58:55.119060 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:55.119064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:55.119077 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:58:55.119196 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:55.119198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:55.119241 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:55.119318 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:55.119761 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.120238 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.120939 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.121215 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.121298 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.123950 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:39577: BlockingRecv error: recv got EOF from 127.8.51.65:39577 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:55.302196 18315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:55.296417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:34761)
0809 07:58:55.296689 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:55.296704 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:55.296805 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:55.297045 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:55.297047 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:55.297240 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:55.297332 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.297337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.298365 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.298369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.299179 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.299190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.299609 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.299612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.299686 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.300193 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:55.300204 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:55.302041 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":74,"threads_started":1}
W20260809 07:58:55.302368 18313 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:55.296514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:34761 (local address 127.8.51.126:46769)
0809 07:58:55.296708 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:55.296713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:55.296776 (+ 63us) server_negotiation.cc:407] Connection header received
0809 07:58:55.296894 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:55.296896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:55.296938 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:55.297006 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:55.297433 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.298245 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.299288 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.299497 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.299577 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.302241 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:34761: BlockingRecv error: recv got EOF from 127.8.51.66:34761 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:55 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:55.488139 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:55.482467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:33017)
0809 07:58:55.482910 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:55.482924 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:55.483044 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:55.483319 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:55.483322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:55.483539 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:55.483627 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.483632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.484405 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.484410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.485002 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:55.485010 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.485488 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.485492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:55.485609 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.486138 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:55.486150 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:55.488027 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":110,"threads_started":1}
W20260809 07:58:55.488317 18313 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:55.482581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:33017 (local address 127.8.51.126:46769)
0809 07:58:55.482733 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:55.482740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:55.482998 (+ 258us) server_negotiation.cc:407] Connection header received
0809 07:58:55.483147 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:55.483152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:55.483202 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:55.483294 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:55.483744 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.484297 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.485135 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:55.485375 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:55.485484 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:55.488142 (+ 2658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:33017: BlockingRecv error: recv got EOF from 127.8.51.67:33017 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:56.130437 18318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:56.124783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:38347)
0809 07:58:56.125057 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:56.125070 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:56.125159 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:56.125402 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:56.125405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:56.125680 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:56.125795 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.125801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.126884 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.126887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.127536 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.127545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.127948 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.127951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.128008 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.128472 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:56.128483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:56.130325 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":87,"threads_started":1}
W20260809 07:58:56.130640 18319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:56.124860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38347 (local address 127.8.51.126:46769)
0809 07:58:56.125124 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:56.125127 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:56.125142 (+ 15us) server_negotiation.cc:407] Connection header received
0809 07:58:56.125246 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:56.125248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:56.125291 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:56.125366 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:56.125941 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.126750 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.127643 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.127854 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.127940 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.130466 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:38347: BlockingRecv error: recv got EOF from 127.8.51.65:38347 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":81,"threads_started":1}
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:56.308640 18320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:56.303055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:42205)
0809 07:58:56.303354 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:56.303370 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:56.303501 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:56.303785 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:56.303789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:56.304006 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:56.304096 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.304101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.304858 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.304862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.305418 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.305426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.305959 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.305963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.306048 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.306542 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:56.306554 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:56.308448 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":110,"threads_started":1}
W20260809 07:58:56.308696 18319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:56.303133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:42205 (local address 127.8.51.126:46769)
0809 07:58:56.303307 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:56.303312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:56.303452 (+ 140us) server_negotiation.cc:407] Connection header received
0809 07:58:56.303604 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:56.303607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:56.303678 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:56.303763 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:56.304225 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.304749 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.305539 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.305831 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.305956 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.308571 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:42205: BlockingRecv error: recv got EOF from 127.8.51.66:42205 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:56 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:56.494690 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:56.488925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:33005)
0809 07:58:56.489272 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:56.489290 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:56.489439 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:56.489719 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:56.489722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:56.489935 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:56.490026 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.490031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.490771 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.490776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.491343 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:56.491350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.491815 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.491818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:56.491902 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.492526 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:56.492559 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:56.494556 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":136,"threads_started":1}
W20260809 07:58:56.494839 18319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:56.489108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:33005 (local address 127.8.51.126:46769)
0809 07:58:56.489272 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:56.489278 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:56.489376 (+ 98us) server_negotiation.cc:407] Connection header received
0809 07:58:56.489536 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:56.489540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:56.489610 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:56.489695 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:56.490161 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.490667 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.491466 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:56.491707 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:56.491812 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:56.494720 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:33005: BlockingRecv error: recv got EOF from 127.8.51.67:33005 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:57.136901 18322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:57.131317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:57469)
0809 07:58:57.131608 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:57.131621 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:57.131730 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:57.131972 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:57.131975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:57.132158 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:57.132255 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.132260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.133030 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.133034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.133923 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.133935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.134385 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.134388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.134447 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.134952 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:57.134964 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:57.136788 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":86,"threads_started":1}
W20260809 07:58:57.137123 18323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:57.131378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:57469 (local address 127.8.51.126:46769)
0809 07:58:57.131638 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:57.131642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:57.131706 (+ 64us) server_negotiation.cc:407] Connection header received
0809 07:58:57.131811 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:57.131813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:57.131857 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:57.131934 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:57.132362 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.132902 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.134048 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.134273 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.134371 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.136925 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:57469: BlockingRecv error: recv got EOF from 127.8.51.65:57469 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":77,"threads_started":1}
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:57.315073 18324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:57.309542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:49405)
0809 07:58:57.309867 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:57.309880 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:57.309984 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:57.310218 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:57.310220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:57.310408 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:57.310503 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.310508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.311197 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.311200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.311719 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.311725 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.312182 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.312187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.312280 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.312941 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:57.312955 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:57.314958 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":103,"threads_started":1}
W20260809 07:58:57.315255 18323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:57.309665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:49405 (local address 127.8.51.126:46769)
0809 07:58:57.309822 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:57.309828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:57.309956 (+ 128us) server_negotiation.cc:407] Connection header received
0809 07:58:57.310065 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:57.310067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:57.310112 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:57.310181 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:57.310612 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.311108 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.311813 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.312017 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.312140 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.315092 (+ 2952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:49405: BlockingRecv error: recv got EOF from 127.8.51.66:49405 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:57 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:57.501683 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:57.495616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:37995)
0809 07:58:57.495965 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:57.495980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:57.496128 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:57.496407 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:57.496410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:57.496625 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:57.496725 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.496731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.497495 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.497501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.498155 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:57.498168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.498639 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.498643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:57.498726 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.499336 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:57.499348 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:57.501468 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":109,"threads_started":1}
W20260809 07:58:57.501801 18323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:57.495737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37995 (local address 127.8.51.126:46769)
0809 07:58:57.495911 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:57.495916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:57.496067 (+ 151us) server_negotiation.cc:407] Connection header received
0809 07:58:57.496232 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:57.496236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:57.496290 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:57.496378 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:57.496847 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.497382 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.498292 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:57.498518 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:57.498629 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:57.501653 (+ 3024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:37995: BlockingRecv error: recv got EOF from 127.8.51.67:37995 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:58.145627 18326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:58.137801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:58209)
0809 07:58:58.138092 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:58.138104 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:58.138201 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:58.138422 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:58.138424 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:58.138598 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:58.138701 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.138706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.139354 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.139356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.139862 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.139869 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.140233 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.140236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.140290 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.143666 (+ 3376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:58.143678 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:58.145467 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":99,"threads_started":1}
W20260809 07:58:58.145803 18327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:58.137857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:58209 (local address 127.8.51.126:46769)
0809 07:58:58.138111 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:58.138114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:58.138173 (+ 59us) server_negotiation.cc:407] Connection header received
0809 07:58:58.138273 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:58.138276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:58.138316 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:58.138387 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:58.138789 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.139268 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.139951 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.140148 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.140214 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.145670 (+ 5456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:58209: BlockingRecv error: recv got EOF from 127.8.51.65:58209 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 07:58:58.323208 18327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:58.317547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55131 (local address 127.8.51.126:46769)
0809 07:58:58.317681 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:58.317688 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:58.317931 (+ 243us) server_negotiation.cc:407] Connection header received
0809 07:58:58.318150 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:58.318155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:58.318206 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:58.318257 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:58.318818 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.319298 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.320101 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.320303 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.320419 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.323120 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:55131: BlockingRecv error: recv got EOF from 127.8.51.66:55131 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:58:58.323213 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:58.317401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:55131)
0809 07:58:58.317850 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:58.317865 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:58.318032 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:58.318429 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:58.318433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:58.318619 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:58.318706 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.318711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.319415 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.319420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.319955 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.319980 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.320424 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.320427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.320506 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.321057 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:58.321068 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:58.323006 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":81,"threads_started":1}
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:58 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:58.507968 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:58.502388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:38361)
0809 07:58:58.502663 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:58.502676 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:58.502804 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:58.503075 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:58.503078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:58.503315 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:58.503407 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.503412 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.504164 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.504170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.504733 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:58.504740 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.505224 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.505228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:58.505327 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.505970 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:58.505982 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:58.507844 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":82,"threads_started":1}
W20260809 07:58:58.508124 18327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:58.502446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38361 (local address 127.8.51.126:46769)
0809 07:58:58.502601 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:58.502605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:58.502770 (+ 165us) server_negotiation.cc:407] Connection header received
0809 07:58:58.502910 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:58.502914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:58.502968 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:58.503050 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:58.503528 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.504056 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.504865 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:58.505088 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:58.505215 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:58.507976 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:38361: BlockingRecv error: recv got EOF from 127.8.51.67:38361 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:59.151546 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:59.146483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:35971)
0809 07:58:59.146773 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:59.146786 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:59.146875 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:59.147113 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:59.147115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:59.147302 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:59.147403 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.147408 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.148091 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.148093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.148637 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.148644 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.149068 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.149071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.149128 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.149622 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:59.149633 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:59.151426 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":98,"threads_started":1}
W20260809 07:58:59.151716 18332 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:59.146606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:35971 (local address 127.8.51.126:46769)
0809 07:58:59.146935 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:59.146938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:59.146950 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:58:59.146985 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:59.146987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:59.147027 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:59.147103 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:59.147496 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.148003 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.148756 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.148978 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.149049 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.151554 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:35971: BlockingRecv error: recv got EOF from 127.8.51.65:35971 (error 108)
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":110,"threads_started":1}
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:59.329807 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:59.324103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:37949)
0809 07:58:59.324422 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:59.324436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:59.324535 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:59.324764 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:59.324766 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:59.324952 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:59.325044 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.325048 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.325831 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.325833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.326423 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.326431 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.326873 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.326875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.326932 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.327575 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:59.327590 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:59.329624 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":141,"threads_started":1}
W20260809 07:58:59.329872 18332 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:59.324275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:37949 (local address 127.8.51.126:46769)
0809 07:58:59.324448 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:59.324452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:59.324491 (+ 39us) server_negotiation.cc:407] Connection header received
0809 07:58:59.324602 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:59.324604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:59.324654 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:59.324727 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:59.325145 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.325737 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.326521 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.326765 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.326867 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.329759 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:37949: BlockingRecv error: recv got EOF from 127.8.51.66:37949 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:58:59 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.67@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:58:59.514219 18334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:58:59.508841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.67:49921)
0809 07:58:59.509115 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 07:58:59.509135 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 07:58:59.509231 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:58:59.509461 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:58:59.509463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:58:59.509694 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:58:59.509785 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.509790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.510478 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.510480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.511001 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:58:59.511008 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.511620 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.511624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:58:59.511710 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.512278 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:58:59.512292 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:58:59.514101 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":80,"threads_started":1}
W20260809 07:58:59.514454 18332 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:58:59.508915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:49921 (local address 127.8.51.126:46769)
0809 07:58:59.509052 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 07:58:59.509055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:58:59.509207 (+ 152us) server_negotiation.cc:407] Connection header received
0809 07:58:59.509311 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:58:59.509313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:58:59.509357 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:58:59.509424 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:58:59.509884 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.510387 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.511126 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:58:59.511472 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:58:59.511575 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:58:59.514224 (+ 2649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.67:49921: BlockingRecv error: recv got EOF from 127.8.51.67:49921 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 07:59:00 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:59:00 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.65@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:59:00.158051 18335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:00.152593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.65:48039)
0809 07:59:00.152888 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:00.152901 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:00.152986 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:00.153210 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:00.153212 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:00.153400 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:00.153494 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.153499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.154234 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.154236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.154906 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.154916 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.155394 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.155398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.155480 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.156021 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:00.156033 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:00.157876 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":88,"threads_started":1}
W20260809 07:59:00.158143 18336 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:59:00.152730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:48039 (local address 127.8.51.126:46769)
0809 07:59:00.152980 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:00.152984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:00.152997 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:59:00.153053 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:00.153055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:00.153096 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:00.153181 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:00.153613 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.154145 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.155040 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.155280 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.155390 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.158011 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.65:48039: BlockingRecv error: recv got EOF from 127.8.51.65:48039 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":79,"threads_started":1}
Aug 09 07:59:00 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 07:59:00 dist-test-slave-njxd krb5kdc[17187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.51.66@KRBTEST.COM for oryx/127.8.51.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 07:59:00.336508 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:00.330798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:46769 (local address 127.8.51.66:40799)
0809 07:59:00.331076 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:00.331099 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:00.331231 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:00.331504 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:00.331507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:00.331723 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:00.331809 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.331815 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.332719 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.332740 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.333308 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.333316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.333855 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.333858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.333942 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.334391 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:00.334402 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:00.336321 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.51.126:46769: Server oryx/127.8.51.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":84,"threads_started":1}
W20260809 07:59:00.336545 18336 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:59:00.330866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:40799 (local address 127.8.51.126:46769)
0809 07:59:00.331034 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:00.331039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:00.331180 (+ 141us) server_negotiation.cc:407] Connection header received
0809 07:59:00.331343 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:00.331351 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:00.331395 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:00.331482 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:00.331932 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.332602 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.333428 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.333742 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.333851 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.336439 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.51.66:40799: BlockingRecv error: recv got EOF from 127.8.51.66:40799 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 07:59:00.409340 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17820
I20260809 07:59:00.416571 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17985
I20260809 07:59:00.422559 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18131
I20260809 07:59:00.429147 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 17745
2026-08-09T07:59:00Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17950 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T07:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:59:00Z Disabled control of system clock
I20260809 07:59:00.461277 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38405
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38405
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 07:59:00.571794 18341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:00.572055 18341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:00.572108 18341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:00.576205 18341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:59:00.576272 18341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:00.576288 18341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:00.576305 18341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:59:00.576321 18341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:59:00.581054 18341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38405
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:00.582167 18341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:00.583643 18341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:00.592492 18347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:00.592519 18346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:00.592550 18341 server_base.cc:1034] running on GCE node
W20260809 07:59:00.592592 18349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:00.593443 18341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:00.594573 18341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:00.595772 18341 hybrid_clock.cc:648] HybridClock initialized: now 1786262340595742 us; error 39 us; skew 500 ppm
I20260809 07:59:00.597669 18341 webserver.cc:460] Webserver started at http://127.8.51.126:44967/ using document root <none> and password file <none>
I20260809 07:59:00.598266 18341 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:00.598359 18341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:00.598596 18341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:00.600610 18341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "aea6ae46374a49dbadb0f62c034592cc"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "1714c86fd0d0ba7e5b46a9526d3db3d1"
server_key_iv: "3c31e67be4413275118ab233fe8c13d5"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.601193 18341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "aea6ae46374a49dbadb0f62c034592cc"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "1714c86fd0d0ba7e5b46a9526d3db3d1"
server_key_iv: "3c31e67be4413275118ab233fe8c13d5"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.604919 18341 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:59:00.607414 18355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:00.608613 18341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 07:59:00.608757 18341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "aea6ae46374a49dbadb0f62c034592cc"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "1714c86fd0d0ba7e5b46a9526d3db3d1"
server_key_iv: "3c31e67be4413275118ab233fe8c13d5"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.608870 18341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:00.628858 18341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:00.629534 18341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:00.629757 18341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:00.636859 18414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38405 every 8 connection(s)
I20260809 07:59:00.636890 18341 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38405
I20260809 07:59:00.637814 18341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:59:00.640980 18415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:00.646253 18415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: Bootstrap starting.
I20260809 07:59:00.647192 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18341
I20260809 07:59:00.647316 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:59:00.647612 8397 external_mini_cluster.cc:1428] Setting key 3d3ee245fafa9054716c8378471799fb
I20260809 07:59:00.648931 18415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:00.649756 18415 log.cc:824] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:00.651824 18415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: No bootstrap required, opened a new log
I20260809 07:59:00.655550 18415 raft_consensus.cc:348] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } }
I20260809 07:59:00.655786 18415 raft_consensus.cc:374] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:00.655874 18415 raft_consensus.cc:729] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea6ae46374a49dbadb0f62c034592cc, State: Initialized, Role: FOLLOWER
I20260809 07:59:00.656378 18415 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } }
I20260809 07:59:00.656507 18415 raft_consensus.cc:388] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:59:00.656602 18415 raft_consensus.cc:482] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:59:00.656725 18415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:00.657284 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:00.648707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53196 (local address 127.8.51.126:38405)
0809 07:59:00.649396 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:00.649410 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:00.649445 (+ 35us) server_negotiation.cc:407] Connection header received
0809 07:59:00.650242 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:00.650267 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:00.650709 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:00.651063 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:00.651515 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.652569 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.653524 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.654059 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.654247 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.655217 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:00.655222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:00.655235 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:00.655618 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:00.655676 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:00.655697 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:00.655812 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:00.656019 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 07:59:00.656306 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":132,"threads_started":1}
I20260809 07:59:00.657754 18415 raft_consensus.cc:504] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } }
I20260809 07:59:00.658087 18415 leader_election.cc:302] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aea6ae46374a49dbadb0f62c034592cc; no voters:
I20260809 07:59:00.658421 18415 leader_election.cc:288] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:59:00.658506 18421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:00.658748 18421 raft_consensus.cc:686] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [term 1 LEADER]: Becoming Leader. State: Replica: aea6ae46374a49dbadb0f62c034592cc, State: Running, Role: LEADER
I20260809 07:59:00.659094 18421 consensus_queue.cc:237] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } }
I20260809 07:59:00.659711 18415 sys_catalog.cc:564] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:59:00.660352 18421 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader aea6ae46374a49dbadb0f62c034592cc. Latest consensus state: current_term: 1 leader_uuid: "aea6ae46374a49dbadb0f62c034592cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } } }
I20260809 07:59:00.660481 18421 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:00.660746 18422 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aea6ae46374a49dbadb0f62c034592cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea6ae46374a49dbadb0f62c034592cc" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38405 } } }
I20260809 07:59:00.660992 18422 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc [sys.catalog]: This master's current role is: LEADER
W20260809 07:59:00.664745 18437 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 07:59:00.664815 18437 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 07:59:00.664901 18427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:59:00.665762 18427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:59:00.671046 18427 catalog_manager.cc:1347] Generated new cluster ID: 64252b5f801845838f0d8e1e290f9c8e
I20260809 07:59:00.671108 18427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:59:00.680363 18427 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:59:00.681491 18427 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:59:00.697924 18427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aea6ae46374a49dbadb0f62c034592cc: Generated new TSK 0
I20260809 07:59:00.698714 18427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:59:00.712523 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--builtin_ntp_servers=127.8.51.84:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 07:59:00.821794 18440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:00.822021 18440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:00.822055 18440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:00.825980 18440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:00.826030 18440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:00.826114 18440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:59:00.830786 18440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:00.831820 18440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:00.833180 18440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:00.842747 18445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:00.842784 18446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:00.842778 18448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:00.842831 18440 server_base.cc:1034] running on GCE node
I20260809 07:59:00.843353 18440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:00.843997 18440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:00.845175 18440 hybrid_clock.cc:648] HybridClock initialized: now 1786262340845152 us; error 32 us; skew 500 ppm
I20260809 07:59:00.846997 18440 webserver.cc:460] Webserver started at http://127.8.51.65:35151/ using document root <none> and password file <none>
I20260809 07:59:00.847569 18440 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:00.847661 18440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:00.847898 18440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:00.849992 18440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "9241a7e1a7314eedb0a20cd9fdfb6eab"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "e4c0d1e6ff8e7c2230a9db34970e0bf4"
server_key_iv: "c312496f31e6623501da0133844f524b"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.850553 18440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "9241a7e1a7314eedb0a20cd9fdfb6eab"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "e4c0d1e6ff8e7c2230a9db34970e0bf4"
server_key_iv: "c312496f31e6623501da0133844f524b"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.854048 18440 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:59:00.856391 18457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:00.857554 18440 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:59:00.857743 18440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "9241a7e1a7314eedb0a20cd9fdfb6eab"
format_stamp: "Formatted at 2026-08-09 07:59:00 on dist-test-slave-njxd"
server_key: "e4c0d1e6ff8e7c2230a9db34970e0bf4"
server_key_iv: "c312496f31e6623501da0133844f524b"
server_key_version: "encryptionkey@0"
I20260809 07:59:00.857851 18440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:00.879995 18440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:00.880698 18440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:00.880898 18440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:00.881628 18440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:00.882570 18440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:00.882615 18440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:00.882655 18440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:00.882687 18440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:00.891422 18440 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:38589
I20260809 07:59:00.891455 18581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:38589 every 8 connection(s)
I20260809 07:59:00.892299 18440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:59:00.899515 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18440
I20260809 07:59:00.899616 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:59:00.899921 8397 external_mini_cluster.cc:1428] Setting key ceeafbccd5a456081a83f11ebd2421de
I20260809 07:59:00.901546 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:00.894022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:54971 (local address 127.8.51.126:38405)
0809 07:59:00.894156 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:00.894160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:00.895229 (+ 1069us) server_negotiation.cc:407] Connection header received
0809 07:59:00.896659 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:00.896663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:00.896729 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:00.896820 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:00.897757 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.898299 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.899463 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.899795 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.899906 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.901064 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:00.901070 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:00.901078 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:00.901089 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:00.901106 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:00.901114 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:00.901188 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:00.901348 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 07:59:00.901408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 07:59:00.901891 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--builtin_ntp_servers=127.8.51.84:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 07:59:00.902555 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:00.894397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38405 (local address 127.8.51.65:54971)
0809 07:59:00.895074 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:00.895114 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:00.896418 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:00.897002 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:00.897009 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:00.897091 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:00.897564 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.897629 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.898432 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.898436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.899334 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:00.899344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:00.899948 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:00.899952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:00.900145 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:00.900811 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:00.900812 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:00.900852 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:00.900911 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:00.901210 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:00.901225 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:00.901229 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 07:59:00.901347 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 07:59:00.901666 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":146,"threads_started":1}
I20260809 07:59:00.903788 18582 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38405
I20260809 07:59:00.904062 18582 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:00.904690 18582 heartbeater.cc:511] Master 127.8.51.126:38405 requested a full tablet report, sending...
I20260809 07:59:00.906368 18372 ts_manager.cc:194] Registered new tserver with Master: 9241a7e1a7314eedb0a20cd9fdfb6eab (127.8.51.65:38589)
I20260809 07:59:00.908102 18372 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.65:54971
W20260809 07:59:01.013523 18585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:01.013782 18585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:01.013818 18585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:01.017724 18585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:01.017772 18585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:01.017823 18585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:59:01.022249 18585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:01.023228 18585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:01.024580 18585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:01.033998 18591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.034008 18593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.034008 18590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.034303 18585 server_base.cc:1034] running on GCE node
I20260809 07:59:01.034739 18585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:01.035363 18585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:01.036551 18585 hybrid_clock.cc:648] HybridClock initialized: now 1786262341036535 us; error 25 us; skew 500 ppm
I20260809 07:59:01.038331 18585 webserver.cc:460] Webserver started at http://127.8.51.66:37129/ using document root <none> and password file <none>
I20260809 07:59:01.038899 18585 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:01.038990 18585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:01.039240 18585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:01.041229 18585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "0d984003e38048a1a9d224982184896f"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "8809024426c7741decaff10af3fc4cef"
server_key_iv: "2167a80a72cc4daf26c2234c260c98c3"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.041854 18585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "0d984003e38048a1a9d224982184896f"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "8809024426c7741decaff10af3fc4cef"
server_key_iv: "2167a80a72cc4daf26c2234c260c98c3"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.045390 18585 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 07:59:01.047906 18600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.049024 18585 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:59:01.049176 18585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "0d984003e38048a1a9d224982184896f"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "8809024426c7741decaff10af3fc4cef"
server_key_iv: "2167a80a72cc4daf26c2234c260c98c3"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.049319 18585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:01.076447 18585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:01.077497 18585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:01.077776 18585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:01.078593 18585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:01.079872 18585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:01.079932 18585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.079998 18585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:01.080032 18585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.088662 18585 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:46781
I20260809 07:59:01.088685 18727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:46781 every 8 connection(s)
I20260809 07:59:01.089628 18585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:59:01.089987 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18585
I20260809 07:59:01.090117 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:59:01.090451 8397 external_mini_cluster.cc:1428] Setting key a223286e0ced5e37c685db20d9d666c5
I20260809 07:59:01.092438 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--builtin_ntp_servers=127.8.51.84:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 07:59:01.098748 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.091329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:60217 (local address 127.8.51.126:38405)
0809 07:59:01.091474 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.091479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.092680 (+ 1201us) server_negotiation.cc:407] Connection header received
0809 07:59:01.094141 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.094144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.094196 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.094299 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.095168 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.095691 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.096810 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.097023 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.097137 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:01.098261 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:01.098265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:01.098267 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:01.098287 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:01.098304 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:01.098312 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:01.098386 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:01.098554 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 07:59:01.098611 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:59:01.099511 18730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.091823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38405 (local address 127.8.51.66:60217)
0809 07:59:01.092524 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:01.092585 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:01.093939 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:01.094467 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:01.094473 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:01.094571 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:01.095030 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:01.095042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.095815 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.095818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:01.096679 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:01.096688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.097169 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.097173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:01.097333 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:01.098008 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:01.098009 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:01.098054 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:01.098113 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:01.098400 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:01.098411 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:01.098421 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 07:59:01.098539 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 07:59:01.098809 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":147,"threads_started":1}
I20260809 07:59:01.100615 18728 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38405
I20260809 07:59:01.100893 18728 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:01.101536 18728 heartbeater.cc:511] Master 127.8.51.126:38405 requested a full tablet report, sending...
I20260809 07:59:01.102713 18372 ts_manager.cc:194] Registered new tserver with Master: 0d984003e38048a1a9d224982184896f (127.8.51.66:46781)
I20260809 07:59:01.103289 18372 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.66:60217
W20260809 07:59:01.203657 18731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:01.203889 18731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:01.203922 18731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:01.207988 18731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:01.208034 18731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:01.208112 18731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:59:01.212972 18731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:01.214090 18731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:01.215396 18731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:01.224668 18737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.224763 18736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.224677 18739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.224850 18731 server_base.cc:1034] running on GCE node
I20260809 07:59:01.225277 18731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:01.225944 18731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:01.227126 18731 hybrid_clock.cc:648] HybridClock initialized: now 1786262341227115 us; error 30 us; skew 500 ppm
I20260809 07:59:01.228984 18731 webserver.cc:460] Webserver started at http://127.8.51.67:38465/ using document root <none> and password file <none>
I20260809 07:59:01.229554 18731 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:01.229696 18731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:01.229913 18731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:01.231894 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "261179ff84484ece902729bc4794cc15"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "613800ea8fb119822cca8e56dc718877"
server_key_iv: "8294105ee33ba54e0c5d6d226c2c66d0"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.232438 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "261179ff84484ece902729bc4794cc15"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "613800ea8fb119822cca8e56dc718877"
server_key_iv: "8294105ee33ba54e0c5d6d226c2c66d0"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.236073 18731 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:59:01.238479 18745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.239575 18731 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:59:01.239706 18731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "261179ff84484ece902729bc4794cc15"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "613800ea8fb119822cca8e56dc718877"
server_key_iv: "8294105ee33ba54e0c5d6d226c2c66d0"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.239811 18731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:01.255666 18731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:01.256286 18731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:01.256492 18731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:01.257030 18731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:01.257949 18731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:01.258018 18731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.258085 18731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:01.258137 18731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.267457 18731 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:43245
I20260809 07:59:01.267481 18868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:43245 every 8 connection(s)
I20260809 07:59:01.268388 18731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:59:01.268991 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18731
I20260809 07:59:01.269095 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:59:01.269397 8397 external_mini_cluster.cc:1428] Setting key 4b122ac0a59b33a806e0a47cf65ba25d
I20260809 07:59:01.277726 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.270294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:58303 (local address 127.8.51.126:38405)
0809 07:59:01.270438 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.270442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.271653 (+ 1211us) server_negotiation.cc:407] Connection header received
0809 07:59:01.273091 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.273094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.273146 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.273221 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.274151 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.274710 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.275854 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.276098 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.276212 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:01.277202 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:01.277206 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:01.277209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:01.277221 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:01.277242 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:01.277257 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:01.277330 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:01.277488 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 07:59:01.277561 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 07:59:01.278512 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.270789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38405 (local address 127.8.51.67:58303)
0809 07:59:01.271486 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:01.271542 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:01.272897 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:01.273381 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:01.273388 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:01.273466 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:01.274015 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:01.274028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.274844 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.274848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:01.275727 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:01.275737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:01.276247 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:01.276251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:01.276420 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:01.276943 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:01.276945 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:01.276983 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:01.277042 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:01.277344 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:01.277352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:01.277358 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 07:59:01.277486 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 07:59:01.277784 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":169,"threads_started":1}
I20260809 07:59:01.279479 18869 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38405
I20260809 07:59:01.279697 18869 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:01.280169 18869 heartbeater.cc:511] Master 127.8.51.126:38405 requested a full tablet report, sending...
I20260809 07:59:01.281083 18372 ts_manager.cc:194] Registered new tserver with Master: 261179ff84484ece902729bc4794cc15 (127.8.51.67:43245)
I20260809 07:59:01.281664 18372 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.67:58303
I20260809 07:59:01.283308 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 07:59:01.286115 18419 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:59:01.285218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53198 (local address 127.8.51.126:38405)
0809 07:59:01.285341 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.285344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.285520 (+ 176us) server_negotiation.cc:407] Connection header received
0809 07:59:01.285663 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.285665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.285707 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.285767 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.286009 (+ 242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53198: BlockingRecv error: recv got EOF from 127.0.0.1:53198 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:59:01.286226 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18440
I20260809 07:59:01.293462 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18585
I20260809 07:59:01.299562 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18731
I20260809 07:59:01.306457 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18341
2026-08-09T07:59:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (875 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T07:59:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:59:01Z Disabled control of system clock
I20260809 07:59:01.336876 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38289
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:41021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 07:59:01.445748 18882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:01.446008 18882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:01.446045 18882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:01.449924 18882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:59:01.449978 18882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:01.449993 18882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:01.450009 18882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:59:01.450023 18882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:59:01.454617 18882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38289
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:01.455644 18882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:01.457000 18882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:01.465134 18890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.465269 18882 server_base.cc:1034] running on GCE node
W20260809 07:59:01.465148 18888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.465144 18887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.466120 18882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:01.467201 18882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:01.468393 18882 hybrid_clock.cc:648] HybridClock initialized: now 1786262341468368 us; error 40 us; skew 500 ppm
I20260809 07:59:01.470328 18882 webserver.cc:460] Webserver started at http://127.8.51.126:40485/ using document root <none> and password file <none>
I20260809 07:59:01.470912 18882 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:01.471004 18882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:01.471256 18882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:01.473389 18882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "c2dc7a42842042869e5561ad0c2b8aee"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "b31a68de8d51b748155a2301c2baf44e"
server_key_iv: "ecdd00a58fb77a5e5796f5599a4d76bd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.474009 18882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "c2dc7a42842042869e5561ad0c2b8aee"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "b31a68de8d51b748155a2301c2baf44e"
server_key_iv: "ecdd00a58fb77a5e5796f5599a4d76bd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.477710 18882 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:59:01.480176 18896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.481426 18882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:59:01.481608 18882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c2dc7a42842042869e5561ad0c2b8aee"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "b31a68de8d51b748155a2301c2baf44e"
server_key_iv: "ecdd00a58fb77a5e5796f5599a4d76bd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.481741 18882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:01.486573 18882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:01.487197 18882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:01.487382 18882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:01.494239 18882 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38289
I20260809 07:59:01.494267 18953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38289 every 8 connection(s)
I20260809 07:59:01.495260 18882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:59:01.498477 18954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:01.502494 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18882
I20260809 07:59:01.502583 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:59:01.502863 8397 external_mini_cluster.cc:1428] Setting key 993042f4a77b9d623f70092be890de64
I20260809 07:59:01.504158 18954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee: Bootstrap starting.
I20260809 07:59:01.506494 18954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:01.507419 18954 log.cc:824] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:01.508805 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.504335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.8.51.126:38289)
0809 07:59:01.504987 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.505003 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.505036 (+ 33us) server_negotiation.cc:407] Connection header received
0809 07:59:01.505753 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.505770 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.506106 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.506418 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.507367 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:01.507372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:01.507383 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:01.507393 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:01.507449 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:01.507465 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:01.507619 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:01.507736 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 07:59:01.507984 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":153,"threads_started":1}
I20260809 07:59:01.509501 18954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee: No bootstrap required, opened a new log
I20260809 07:59:01.513008 18954 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } }
I20260809 07:59:01.513213 18954 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:01.513248 18954 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dc7a42842042869e5561ad0c2b8aee, State: Initialized, Role: FOLLOWER
I20260809 07:59:01.513700 18954 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } }
I20260809 07:59:01.513825 18954 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:59:01.513882 18954 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:59:01.513952 18954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:01.514814 18954 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } }
I20260809 07:59:01.515139 18954 leader_election.cc:302] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2dc7a42842042869e5561ad0c2b8aee; no voters:
I20260809 07:59:01.515390 18954 leader_election.cc:288] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:59:01.515525 18960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:01.515770 18960 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [term 1 LEADER]: Becoming Leader. State: Replica: c2dc7a42842042869e5561ad0c2b8aee, State: Running, Role: LEADER
I20260809 07:59:01.516094 18960 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } }
I20260809 07:59:01.516716 18954 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:59:01.517834 18962 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2dc7a42842042869e5561ad0c2b8aee. Latest consensus state: current_term: 1 leader_uuid: "c2dc7a42842042869e5561ad0c2b8aee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } } }
I20260809 07:59:01.517963 18962 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:01.518283 18961 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2dc7a42842042869e5561ad0c2b8aee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2dc7a42842042869e5561ad0c2b8aee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38289 } } }
I20260809 07:59:01.518384 18961 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:01.518383 18970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:59:01.521054 18970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:59:01.526324 18970 catalog_manager.cc:1347] Generated new cluster ID: 562e684e0181414ca463ac24712420ed
I20260809 07:59:01.526460 18970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:59:01.543215 18970 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:59:01.543514 18970 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:59:01.552896 18970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2dc7a42842042869e5561ad0c2b8aee: Generated new TSK 0
I20260809 07:59:01.553556 18970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 07:59:01.560720 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--builtin_ntp_servers=127.8.51.84:41021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 07:59:01.676704 18980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:01.676949 18980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:01.676987 18980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:01.680907 18980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:01.680953 18980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:01.681005 18980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:59:01.685554 18980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:01.686654 18980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:01.688005 18980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:01.697211 18989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.697217 18985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.697217 18986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.697695 18980 server_base.cc:1034] running on GCE node
I20260809 07:59:01.698062 18980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:01.698609 18980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:01.699779 18980 hybrid_clock.cc:648] HybridClock initialized: now 1786262341699757 us; error 33 us; skew 500 ppm
I20260809 07:59:01.701506 18980 webserver.cc:460] Webserver started at http://127.8.51.65:38085/ using document root <none> and password file <none>
I20260809 07:59:01.702100 18980 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:01.702164 18980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:01.702410 18980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:01.704396 18980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "3e3a340112a84fb581645e888b5c3811"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "fa27ccb380d62cf2e865929ae14743a0"
server_key_iv: "c51fafe5f24ed64c1f11bc58dc95ebdd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.704957 18980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "3e3a340112a84fb581645e888b5c3811"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "fa27ccb380d62cf2e865929ae14743a0"
server_key_iv: "c51fafe5f24ed64c1f11bc58dc95ebdd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.708494 18980 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:59:01.710924 18995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.712136 18980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:59:01.712261 18980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "3e3a340112a84fb581645e888b5c3811"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "fa27ccb380d62cf2e865929ae14743a0"
server_key_iv: "c51fafe5f24ed64c1f11bc58dc95ebdd"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.712371 18980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:01.716847 18980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:01.717512 18980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:01.717708 18980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:01.718314 18980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:01.719185 18980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:01.719254 18980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.719316 18980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:01.719347 18980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.727206 18980 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:39749
I20260809 07:59:01.727253 19115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:39749 every 8 connection(s)
I20260809 07:59:01.728091 18980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:59:01.728363 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 18980
I20260809 07:59:01.728506 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:59:01.728796 8397 external_mini_cluster.cc:1428] Setting key d00de699aafc06d8c24fb8b0cb6d698a
I20260809 07:59:01.731119 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--builtin_ntp_servers=127.8.51.84:41021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 07:59:01.735067 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.729954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38837 (local address 127.8.51.126:38289)
0809 07:59:01.730077 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.730081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.731403 (+ 1322us) server_negotiation.cc:407] Connection header received
0809 07:59:01.733272 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.733276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.733316 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.733394 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.734559 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:01.734563 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:01.734594 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:01.734607 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:01.734635 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:01.734644 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:01.734747 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:01.734889 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 07:59:01.734934 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:59:01.736136 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.730427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38289 (local address 127.8.51.65:38837)
0809 07:59:01.731266 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:01.731320 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:01.733052 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:01.733549 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:01.733556 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:01.733712 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:01.734299 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:01.734301 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:01.734339 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:01.734403 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:01.734735 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:01.734744 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:01.734751 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:59:01.734931 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 07:59:01.735358 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":123,"threads_started":1}
I20260809 07:59:01.737494 19116 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38289
I20260809 07:59:01.737780 19116 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:01.738152 19116 heartbeater.cc:511] Master 127.8.51.126:38289 requested a full tablet report, sending...
I20260809 07:59:01.739750 18913 ts_manager.cc:194] Registered new tserver with Master: 3e3a340112a84fb581645e888b5c3811 (127.8.51.65:39749)
W20260809 07:59:01.841806 19119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:01.842036 19119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:01.842070 19119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:01.845680 19119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:01.845722 19119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:01.845772 19119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:59:01.850257 19119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:01.851227 19119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:01.852594 19119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:01.861536 19125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:01.861542 19124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.861708 19119 server_base.cc:1034] running on GCE node
W20260809 07:59:01.861649 19127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:01.862437 19119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:01.862993 19119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:01.864158 19119 hybrid_clock.cc:648] HybridClock initialized: now 1786262341864132 us; error 39 us; skew 500 ppm
I20260809 07:59:01.865919 19119 webserver.cc:460] Webserver started at http://127.8.51.66:37717/ using document root <none> and password file <none>
I20260809 07:59:01.866463 19119 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:01.866577 19119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:01.866806 19119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:01.868764 19119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "2fd9367c4b9c47a7ad3f4498cf7369ff"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "a32605daacc680ff2428459949410901"
server_key_iv: "ea4c80262327903d69064ba61d168b2d"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.869333 19119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "2fd9367c4b9c47a7ad3f4498cf7369ff"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "a32605daacc680ff2428459949410901"
server_key_iv: "ea4c80262327903d69064ba61d168b2d"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.872696 19119 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 07:59:01.875152 19134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.876343 19119 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:59:01.876478 19119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "2fd9367c4b9c47a7ad3f4498cf7369ff"
format_stamp: "Formatted at 2026-08-09 07:59:01 on dist-test-slave-njxd"
server_key: "a32605daacc680ff2428459949410901"
server_key_iv: "ea4c80262327903d69064ba61d168b2d"
server_key_version: "encryptionkey@0"
I20260809 07:59:01.876586 19119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:01.880892 19119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:01.881438 19119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:01.881659 19119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:01.882174 19119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:01.883036 19119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:01.883109 19119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.883175 19119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:01.883227 19119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:01.891649 19119 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:34315
I20260809 07:59:01.891670 19255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:34315 every 8 connection(s)
I20260809 07:59:01.892485 19119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:59:01.898095 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19119
I20260809 07:59:01.898216 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:59:01.898473 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.894253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55967 (local address 127.8.51.126:38289)
0809 07:59:01.894385 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:01.894389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:01.895375 (+ 986us) server_negotiation.cc:407] Connection header received
0809 07:59:01.896698 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:01.896701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:01.896750 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:01.896855 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:01.897997 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:01.898000 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:01.898002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:01.898014 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:01.898034 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:01.898041 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:01.898120 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:01.898300 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 07:59:01.898349 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 07:59:01.898540 8397 external_mini_cluster.cc:1428] Setting key 890c2ff086ecaad50e026fb3636b232b
I20260809 07:59:01.899434 19258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:01.894594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38289 (local address 127.8.51.66:55967)
0809 07:59:01.895226 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:01.895263 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:01.896482 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:01.897017 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:01.897023 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:01.897108 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:01.897680 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:01.897682 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:01.897735 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:01.897798 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:01.898129 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:01.898138 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:01.898145 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:59:01.898323 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 07:59:01.898574 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":117,"threads_started":1}
I20260809 07:59:01.900521 19256 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38289
I20260809 07:59:01.900676 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--builtin_ntp_servers=127.8.51.84:41021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 07:59:01.900745 19256 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:01.901136 19256 heartbeater.cc:511] Master 127.8.51.126:38289 requested a full tablet report, sending...
I20260809 07:59:01.902168 18913 ts_manager.cc:194] Registered new tserver with Master: 2fd9367c4b9c47a7ad3f4498cf7369ff (127.8.51.66:34315)
W20260809 07:59:02.013924 19259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:02.014183 19259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:02.014221 19259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:02.018643 19259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:02.018710 19259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:02.018792 19259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:59:02.023454 19259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:02.024509 19259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:02.025974 19259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:02.035320 19268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:02.035372 19259 server_base.cc:1034] running on GCE node
W20260809 07:59:02.035486 19266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:02.035331 19265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:02.036073 19259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:02.036711 19259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:02.037890 19259 hybrid_clock.cc:648] HybridClock initialized: now 1786262342037881 us; error 31 us; skew 500 ppm
I20260809 07:59:02.039554 19259 webserver.cc:460] Webserver started at http://127.8.51.67:41969/ using document root <none> and password file <none>
I20260809 07:59:02.040112 19259 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:02.040199 19259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:02.040428 19259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:02.042430 19259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "8e11b4c4597d444abf1ca9b452c682af"
format_stamp: "Formatted at 2026-08-09 07:59:02 on dist-test-slave-njxd"
server_key: "06ebbb5deaa28119290d667a098dd68d"
server_key_iv: "bf581348713815fb271f5b162d39153c"
server_key_version: "encryptionkey@0"
I20260809 07:59:02.042979 19259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "8e11b4c4597d444abf1ca9b452c682af"
format_stamp: "Formatted at 2026-08-09 07:59:02 on dist-test-slave-njxd"
server_key: "06ebbb5deaa28119290d667a098dd68d"
server_key_iv: "bf581348713815fb271f5b162d39153c"
server_key_version: "encryptionkey@0"
I20260809 07:59:02.046424 19259 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 07:59:02.049062 19276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:02.050302 19259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:59:02.050434 19259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "8e11b4c4597d444abf1ca9b452c682af"
format_stamp: "Formatted at 2026-08-09 07:59:02 on dist-test-slave-njxd"
server_key: "06ebbb5deaa28119290d667a098dd68d"
server_key_iv: "bf581348713815fb271f5b162d39153c"
server_key_version: "encryptionkey@0"
I20260809 07:59:02.050544 19259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:02.055241 19259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:02.055838 19259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:02.056011 19259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:02.056555 19259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:02.057471 19259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:02.057547 19259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:02.057628 19259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:02.057673 19259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:02.066170 19259 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:38969
I20260809 07:59:02.066223 19396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:38969 every 8 connection(s)
I20260809 07:59:02.067083 19259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:59:02.067680 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19259
I20260809 07:59:02.067811 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:59:02.068096 8397 external_mini_cluster.cc:1428] Setting key 2cc19177c088ab3303274c5023a7fca7
I20260809 07:59:02.074839 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:02.068992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:41691 (local address 127.8.51.126:38289)
0809 07:59:02.069138 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:02.069142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:02.071450 (+ 2308us) server_negotiation.cc:407] Connection header received
0809 07:59:02.073041 (+ 1591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:02.073044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:02.073089 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:02.073165 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:02.074330 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:02.074333 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:02.074336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 07:59:02.074348 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:02.074370 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 07:59:02.074383 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:02.074464 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:02.074659 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 07:59:02.074707 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 07:59:02.075721 19400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:02.069489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38289 (local address 127.8.51.67:41691)
0809 07:59:02.071280 (+ 1791us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:02.071336 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:02.072821 (+ 1485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:02.073335 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:02.073341 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:02.073428 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:02.074069 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 07:59:02.074070 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:02.074112 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 07:59:02.074180 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:02.074475 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:02.074485 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:02.074492 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 07:59:02.074686 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 07:59:02.074993 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1259,"thread_start_us":124,"threads_started":1}
I20260809 07:59:02.077078 19398 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38289
I20260809 07:59:02.077332 19398 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:02.077885 19398 heartbeater.cc:511] Master 127.8.51.126:38289 requested a full tablet report, sending...
I20260809 07:59:02.079089 18913 ts_manager.cc:194] Registered new tserver with Master: 8e11b4c4597d444abf1ca9b452c682af (127.8.51.67:38969)
I20260809 07:59:02.083604 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 07:59:02.087204 18958 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 07:59:02.086066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34272 (local address 127.8.51.126:38289)
0809 07:59:02.086229 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:02.086233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:02.086425 (+ 192us) server_negotiation.cc:407] Connection header received
0809 07:59:02.086619 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:02.086624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:02.086664 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:02.086739 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:02.087046 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34272: BlockingRecv error: recv got EOF from 127.0.0.1:34272 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 07:59:02.087513 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18980
I20260809 07:59:02.099212 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19119
I20260809 07:59:02.108058 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19259
I20260809 07:59:02.118418 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 18882
2026-08-09T07:59:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (812 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:59:02 dist-test-slave-njxd krb5kdc[19409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:59:02 dist-test-slave-njxd krb5kdc[19409](info): set up 2 sockets
Aug 09 07:59:02 dist-test-slave-njxd krb5kdc[19409](info): commencing operation
krb5kdc: starting...
W20260809 07:59:03.172458 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:59:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:59:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:59:03.296427 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42183
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:03.402441 19422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:03.402741 19422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:03.402832 19422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:03.406688 19422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:59:03.406780 19422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:03.406819 19422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:03.406857 19422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:59:03.406891 19422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:59:03.412020 19422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:03.413077 19422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:03.414096 19422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:03.422489 19430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.422492 19432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.422495 19429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:03.422713 19422 server_base.cc:1034] running on GCE node
I20260809 07:59:03.423384 19422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:03.424443 19422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:03.425653 19422 hybrid_clock.cc:648] HybridClock initialized: now 1786262343425639 us; error 35 us; skew 500 ppm
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:03.432243 19422 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:59:03.433233 19422 webserver.cc:460] Webserver started at http://127.8.51.126:35567/ using document root <none> and password file <none>
I20260809 07:59:03.433887 19422 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:03.433982 19422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:03.434223 19422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:03.436285 19422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "a10f14ce94ad416eb9dce15f4e228d9e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "ef41a40260a0823110ac6d26ac32e7c9"
server_key_iv: "82c801d88fc6494379d14fd79748e7c6"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.436843 19422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "a10f14ce94ad416eb9dce15f4e228d9e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "ef41a40260a0823110ac6d26ac32e7c9"
server_key_iv: "82c801d88fc6494379d14fd79748e7c6"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.440582 19422 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 07:59:03.443012 19440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.444164 19422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 07:59:03.444306 19422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "a10f14ce94ad416eb9dce15f4e228d9e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "ef41a40260a0823110ac6d26ac32e7c9"
server_key_iv: "82c801d88fc6494379d14fd79748e7c6"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.444413 19422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:03.477353 19422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:03.480343 19422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:03.480558 19422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:03.487532 19422 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:42183
I20260809 07:59:03.487829 19495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:42183 every 8 connection(s)
I20260809 07:59:03.488526 19422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:59:03.491338 19496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:03.492939 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19422
I20260809 07:59:03.493062 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:59:03.493366 8397 external_mini_cluster.cc:1428] Setting key c56b8e284a8aa81b3a86470c8618cde3
I20260809 07:59:03.497816 19496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: Bootstrap starting.
I20260809 07:59:03.500348 19496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:03.501248 19496 log.cc:824] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: Log is configured to *not* fsync() on all Append() calls
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:03.503360 19496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: No bootstrap required, opened a new log
I20260809 07:59:03.507248 19496 raft_consensus.cc:348] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } }
I20260809 07:59:03.507489 19496 raft_consensus.cc:374] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:03.507567 19496 raft_consensus.cc:729] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10f14ce94ad416eb9dce15f4e228d9e, State: Initialized, Role: FOLLOWER
I20260809 07:59:03.507706 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:03.494800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54570 (local address 127.8.51.126:42183)
0809 07:59:03.495186 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:03.495202 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:03.495238 (+ 36us) server_negotiation.cc:407] Connection header received
0809 07:59:03.495853 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:03.495868 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:03.496185 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:03.496454 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:03.497362 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.498423 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.499594 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.500146 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.500335 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:03.502917 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:03.502924 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:03.502939 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:03.502968 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:03.504738 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.505301 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.505306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.505310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.505416 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.505744 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.505746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.505747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.506126 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:03.506279 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:03.506570 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 07:59:03.506913 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":132,"threads_started":1}
I20260809 07:59:03.508072 19496 consensus_queue.cc:260] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } }
I20260809 07:59:03.508219 19496 raft_consensus.cc:388] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:59:03.508306 19496 raft_consensus.cc:482] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:59:03.508400 19496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:03.509423 19496 raft_consensus.cc:504] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } }
I20260809 07:59:03.509781 19496 leader_election.cc:302] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a10f14ce94ad416eb9dce15f4e228d9e; no voters:
I20260809 07:59:03.510113 19496 leader_election.cc:288] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:59:03.510237 19501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:03.510461 19501 raft_consensus.cc:686] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [term 1 LEADER]: Becoming Leader. State: Replica: a10f14ce94ad416eb9dce15f4e228d9e, State: Running, Role: LEADER
I20260809 07:59:03.510771 19501 consensus_queue.cc:237] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } }
I20260809 07:59:03.511270 19496 sys_catalog.cc:564] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:59:03.512266 19503 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a10f14ce94ad416eb9dce15f4e228d9e. Latest consensus state: current_term: 1 leader_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } } }
I20260809 07:59:03.512400 19503 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:03.512688 19502 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a10f14ce94ad416eb9dce15f4e228d9e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42183 } } }
I20260809 07:59:03.512776 19502 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:03.512876 19511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:59:03.515597 19511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:59:03.520701 19511 catalog_manager.cc:1347] Generated new cluster ID: 143045b5fc264ab09a88c05786fa5370
I20260809 07:59:03.520787 19511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:59:03.525068 19511 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:59:03.526180 19511 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:59:03.535547 19511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: Generated new TSK 0
I20260809 07:59:03.536165 19511 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:59:03.568795 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:03.681823 19523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:03.682062 19523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:03.682101 19523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:03.686058 19523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:03.686111 19523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:03.686168 19523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:59:03.691082 19523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:03.692026 19523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:03.693002 19523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:03.702327 19529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.702349 19528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.702342 19531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:03.702699 19523 server_base.cc:1034] running on GCE node
I20260809 07:59:03.703114 19523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:03.703694 19523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:03.704872 19523 hybrid_clock.cc:648] HybridClock initialized: now 1786262343704862 us; error 30 us; skew 500 ppm
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:03.707592 19523 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:59:03.708400 19523 webserver.cc:460] Webserver started at http://127.8.51.65:32991/ using document root <none> and password file <none>
I20260809 07:59:03.708968 19523 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:03.709057 19523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:03.709290 19523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:03.711378 19523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "36f0e3e39b954e45bd62bfcb852ed72e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "f4a5bea353047fa5bc03918cc3586030"
server_key_iv: "453bb089b47a52b3e0548b6b246cb4fd"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.712028 19523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "36f0e3e39b954e45bd62bfcb852ed72e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "f4a5bea353047fa5bc03918cc3586030"
server_key_iv: "453bb089b47a52b3e0548b6b246cb4fd"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.715862 19523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:59:03.718302 19538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.719604 19523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 07:59:03.719743 19523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "36f0e3e39b954e45bd62bfcb852ed72e"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "f4a5bea353047fa5bc03918cc3586030"
server_key_iv: "453bb089b47a52b3e0548b6b246cb4fd"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.719852 19523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:03.735466 19523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:03.738230 19523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:03.738448 19523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:03.738993 19523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:03.739780 19523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:03.739863 19523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.739930 19523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:03.739979 19523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.748420 19523 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:44253
I20260809 07:59:03.748540 19664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:44253 every 8 connection(s)
I20260809 07:59:03.749312 19523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:59:03.755252 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19523
I20260809 07:59:03.755384 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:59:03.755684 8397 external_mini_cluster.cc:1428] Setting key de8f9489792e558f9629bba6e9724a1a
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:03.763391 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:03.751127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:54433 (local address 127.8.51.126:42183)
0809 07:59:03.751271 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:03.751275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:03.752164 (+ 889us) server_negotiation.cc:407] Connection header received
0809 07:59:03.753433 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:03.753435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:03.753481 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:03.753551 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:03.754715 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.755242 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.756496 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.756782 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.756915 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:03.759707 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:03.759710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:03.759711 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:03.759733 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:03.761085 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.761754 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.761757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.761758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.761837 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.762241 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.762243 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.762244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.762409 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:03.762481 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:03.763162 (+ 681us) server_negotiation.cc:299] Negotiation successful
0809 07:59:03.763268 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":57}
I20260809 07:59:03.764660 19667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:03.751504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42183 (local address 127.8.51.65:54433)
0809 07:59:03.751987 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:03.752041 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:03.753248 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:03.753744 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:03.753750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:03.754083 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:03.754573 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:03.754587 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.755378 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.755383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:03.756335 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:03.756345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.756972 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.756978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:03.757195 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:03.757828 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:03.757844 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:03.759556 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:03.761203 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:03.761212 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:03.761230 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:03.761658 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:03.761939 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:03.761945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:03.761950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:03.762141 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:03.762524 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:03.762533 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:03.762879 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 07:59:03.763110 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 07:59:03.763474 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":115,"threads_started":1}
I20260809 07:59:03.765946 19665 heartbeater.cc:347] Connected to a master server at 127.8.51.126:42183
I20260809 07:59:03.766197 19665 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:03.766819 19665 heartbeater.cc:511] Master 127.8.51.126:42183 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 07:59:03.768340 19458 ts_manager.cc:194] Registered new tserver with Master: 36f0e3e39b954e45bd62bfcb852ed72e (127.8.51.65:44253)
I20260809 07:59:03.769510 19458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:54433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:59:03.785221 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:03.894886 19670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:03.895145 19670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:03.895186 19670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:03.899147 19670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:03.899195 19670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:03.899288 19670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:59:03.904372 19670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:03.905339 19670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:03.906338 19670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:03.915884 19678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.915921 19675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:03.915911 19676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:03.916086 19670 server_base.cc:1034] running on GCE node
I20260809 07:59:03.916558 19670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:03.917140 19670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:03.918298 19670 hybrid_clock.cc:648] HybridClock initialized: now 1786262343918286 us; error 23 us; skew 500 ppm
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:03.921401 19670 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:59:03.922371 19670 webserver.cc:460] Webserver started at http://127.8.51.66:37723/ using document root <none> and password file <none>
I20260809 07:59:03.922966 19670 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:03.923065 19670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:03.923298 19670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:03.925333 19670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "1452056da0c34df3be7d3cde44ab0ffc"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "7bed90385e33039c986e154034f02a1b"
server_key_iv: "7df4ea525ccfc6d465d87e45bbce8cc8"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.925911 19670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "1452056da0c34df3be7d3cde44ab0ffc"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "7bed90385e33039c986e154034f02a1b"
server_key_iv: "7df4ea525ccfc6d465d87e45bbce8cc8"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.929445 19670 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 07:59:03.931802 19685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.932945 19670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 07:59:03.933087 19670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "1452056da0c34df3be7d3cde44ab0ffc"
format_stamp: "Formatted at 2026-08-09 07:59:03 on dist-test-slave-njxd"
server_key: "7bed90385e33039c986e154034f02a1b"
server_key_iv: "7df4ea525ccfc6d465d87e45bbce8cc8"
server_key_version: "encryptionkey@0"
I20260809 07:59:03.933193 19670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:03.951527 19670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:03.954932 19670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:03.955130 19670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:03.955713 19670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:03.956504 19670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:03.956550 19670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.956616 19670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:03.956656 19670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:03.964915 19670 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:44867
I20260809 07:59:03.965087 19807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:44867 every 8 connection(s)
I20260809 07:59:03.965924 19670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:59:03.971751 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19670
I20260809 07:59:03.971845 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:59:03.972136 8397 external_mini_cluster.cc:1428] Setting key 51c7ba12741929b6b2443f6a1eda0031
Aug 09 07:59:03 dist-test-slave-njxd krb5kdc[19409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262343, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:03.980252 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:03.967677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36733 (local address 127.8.51.126:42183)
0809 07:59:03.967856 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:03.967860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:03.968507 (+ 647us) server_negotiation.cc:407] Connection header received
0809 07:59:03.969807 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:03.969810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:03.969855 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:03.969928 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:03.971016 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.971598 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.972920 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.973233 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.973345 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:03.976274 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:03.976277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:03.976279 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:03.976320 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:03.977955 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.978610 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.978613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.978615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.978689 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:03.979082 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:03.979084 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:03.979086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:03.979255 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:03.979328 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:03.980023 (+ 695us) server_negotiation.cc:299] Negotiation successful
0809 07:59:03.980123 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 07:59:03.981487 19811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:03.967952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42183 (local address 127.8.51.66:36733)
0809 07:59:03.968358 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:03.968397 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:03.969566 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:03.970094 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:03.970100 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:03.970437 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:03.970896 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:03.970908 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.971730 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.971732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:03.972792 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:03.972803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:03.973399 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:03.973403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:03.973565 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:03.974229 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:03.974245 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:03.976095 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:03.978076 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:03.978086 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:03.978104 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:03.978499 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:03.978785 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:03.978789 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:03.978794 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:03.978990 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:03.979363 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:03.979372 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:03.979751 (+ 379us) client_negotiation.cc:769] Sending connection context
0809 07:59:03.979997 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 07:59:03.980379 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":97,"threads_started":1}
I20260809 07:59:03.982826 19808 heartbeater.cc:347] Connected to a master server at 127.8.51.126:42183
I20260809 07:59:03.983105 19808 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:59:03.983855 19808 heartbeater.cc:511] Master 127.8.51.126:42183 requested a full tablet report, sending...
I20260809 07:59:03.984989 19458 ts_manager.cc:194] Registered new tserver with Master: 1452056da0c34df3be7d3cde44ab0ffc (127.8.51.66:44867)
I20260809 07:59:03.985518 19458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:36733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:59:04.000960 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:04.126220 19814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:04.126458 19814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:04.126499 19814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:04.130404 19814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:04.130455 19814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:04.130510 19814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:59:04.135655 19814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:42183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:04.136811 19814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:04.137992 19814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:04.148000 19822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:04.148034 19820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:04.148056 19819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:04.148221 19814 server_base.cc:1034] running on GCE node
I20260809 07:59:04.148759 19814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:04.149400 19814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:04.150573 19814 hybrid_clock.cc:648] HybridClock initialized: now 1786262344150551 us; error 38 us; skew 500 ppm
Aug 09 07:59:04 dist-test-slave-njxd krb5kdc[19409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262344, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:04.153154 19814 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:59:04.154022 19814 webserver.cc:460] Webserver started at http://127.8.51.67:36935/ using document root <none> and password file <none>
I20260809 07:59:04.154582 19814 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:04.154671 19814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:04.154899 19814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 07:59:04.156976 19814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "a1bee3814deb4f14b42653a45cbb563d"
format_stamp: "Formatted at 2026-08-09 07:59:04 on dist-test-slave-njxd"
server_key: "49bbf523f3cba7bc88be7e2be4b7ad05"
server_key_iv: "916c96d25398ab2dc10651252a40b27c"
server_key_version: "encryptionkey@0"
I20260809 07:59:04.157521 19814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "a1bee3814deb4f14b42653a45cbb563d"
format_stamp: "Formatted at 2026-08-09 07:59:04 on dist-test-slave-njxd"
server_key: "49bbf523f3cba7bc88be7e2be4b7ad05"
server_key_iv: "916c96d25398ab2dc10651252a40b27c"
server_key_version: "encryptionkey@0"
I20260809 07:59:04.160974 19814 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 07:59:04.163357 19831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:04.164503 19814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 07:59:04.164651 19814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "a1bee3814deb4f14b42653a45cbb563d"
format_stamp: "Formatted at 2026-08-09 07:59:04 on dist-test-slave-njxd"
server_key: "49bbf523f3cba7bc88be7e2be4b7ad05"
server_key_iv: "916c96d25398ab2dc10651252a40b27c"
server_key_version: "encryptionkey@0"
I20260809 07:59:04.164759 19814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:04.181891 19814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:04.184604 19814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:04.184798 19814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:04.185349 19814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:04.186223 19814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:04.186291 19814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:04.186362 19814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:04.186417 19814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:04.195271 19814 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:43763
I20260809 07:59:04.195302 19953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:43763 every 8 connection(s)
I20260809 07:59:04.196118 19814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:59:04.197222 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 19814
I20260809 07:59:04.197316 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:59:04.197675 8397 external_mini_cluster.cc:1428] Setting key 6391df09d9e18d96a2945401ce9d872f
Aug 09 07:59:04 dist-test-slave-njxd krb5kdc[19409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262344, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:04.209122 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.198029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:41687 (local address 127.8.51.126:42183)
0809 07:59:04.198196 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.198201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.199142 (+ 941us) server_negotiation.cc:407] Connection header received
0809 07:59:04.200617 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.200620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.200665 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.200742 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:04.201894 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.202407 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.203458 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.203658 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.203737 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.205975 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:04.205978 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:04.205980 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:04.206001 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:04.207469 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:04.207887 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:04.207890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:04.207891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:04.207962 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:04.208254 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:04.208256 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:04.208257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:04.208417 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:04.208490 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.208912 (+ 422us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.209003 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 07:59:04.210068 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.198461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42183 (local address 127.8.51.67:41687)
0809 07:59:04.198991 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.199047 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.200426 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.200874 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.200881 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.201241 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:04.201773 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.201788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.202508 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.202510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.203359 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.203368 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.203785 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.203788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.203920 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.204428 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:04.204444 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:04.205831 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:04.207562 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:04.207566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:04.207576 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:04.207805 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:04.208039 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:04.208041 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:04.208042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:04.208172 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:04.208504 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:04.208508 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:04.208715 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.208862 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.209095 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":149,"threads_started":1}
I20260809 07:59:04.211241 19954 heartbeater.cc:347] Connected to a master server at 127.8.51.126:42183
I20260809 07:59:04.211527 19954 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:04.212071 19954 heartbeater.cc:511] Master 127.8.51.126:42183 requested a full tablet report, sending...
I20260809 07:59:04.212990 19458 ts_manager.cc:194] Registered new tserver with Master: a1bee3814deb4f14b42653a45cbb563d (127.8.51.67:43763)
I20260809 07:59:04.213562 19458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:41687
I20260809 07:59:04.223237 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:59:04.232324 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.225107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54586 (local address 127.8.51.126:42183)
0809 07:59:04.225238 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.225243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.225418 (+ 175us) server_negotiation.cc:407] Connection header received
0809 07:59:04.225559 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.225562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.225644 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.225730 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:04.226402 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.226916 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.227756 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.227982 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.228083 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.229493 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:04.229498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:04.229505 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:04.229526 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:04.230697 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:04.231096 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:04.231100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:04.231102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:04.231181 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:04.231445 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:04.231449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:04.231451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:04.231670 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:04.231819 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.232060 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.232169 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 07:59:04.234853 19458 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:59:04.238142 19458 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:59:04.252429 19966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.246327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.8.51.67:43763)
0809 07:59:04.246664 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.246676 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.247029 (+ 353us) server_negotiation.cc:407] Connection header received
0809 07:59:04.247324 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.247330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.247560 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.247716 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.248216 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249365 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.251176 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.251719 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.251843 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.251985 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.252154 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.252279 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":112,"threads_started":1}
I20260809 07:59:04.252517 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.246834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52048 (local address 127.8.51.65:44253)
0809 07:59:04.247744 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.247786 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.247809 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:59:04.247887 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.247894 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.248081 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.248569 (+ 488us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.248718 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249797 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.251163 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.251934 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.252086 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.252221 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.252308 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.252381 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":74,"threads_started":1}
I20260809 07:59:04.252533 19967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.246394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44253 (local address 127.0.0.1:52048)
0809 07:59:04.247078 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.247093 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.247198 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.248243 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.248246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.248267 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.248376 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.248382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249934 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.249938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.251007 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.251016 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.252091 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.252096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.252181 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.252203 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.252270 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.252380 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":78,"thread_start_us":97,"threads_started":1}
I20260809 07:59:04.252864 19965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.246152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:43763 (local address 127.0.0.1:57930)
0809 07:59:04.246895 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.246947 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.247139 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.247929 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.247934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.247956 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.248072 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.248078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249490 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.249493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.251017 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.251027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.251843 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.251846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.251949 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.251984 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.252632 (+ 648us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.252708 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":146,"thread_start_us":76,"threads_started":1}
I20260809 07:59:04.253288 19970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.246873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44867 (local address 127.0.0.1:60292)
0809 07:59:04.247414 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.247428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.247503 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.248125 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.248129 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.248145 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.248241 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.248250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249282 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.249288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.250982 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.250994 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.252863 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.252867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.252976 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.253006 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.253091 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.253159 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":206,"thread_start_us":88,"threads_started":1}
I20260809 07:59:04.253381 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.247267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60292 (local address 127.8.51.66:44867)
0809 07:59:04.247716 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.247728 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.247744 (+ 16us) server_negotiation.cc:407] Connection header received
0809 07:59:04.247836 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.247846 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.247977 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.248121 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.248357 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.249155 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.251115 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.251934 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.252086 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.252221 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.253135 (+ 914us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.253238 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":110,"threads_started":1}
I20260809 07:59:04.255869 19884 tablet_service.cc:1467] Processing CreateTablet for tablet c408a683de314eab8bd0b602ca317d9f (DEFAULT_TABLE table=test-table [id=0fc069d5235f43679c3433ca4ddd7aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:04.255838 19596 tablet_service.cc:1467] Processing CreateTablet for tablet c408a683de314eab8bd0b602ca317d9f (DEFAULT_TABLE table=test-table [id=0fc069d5235f43679c3433ca4ddd7aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:04.256108 19738 tablet_service.cc:1467] Processing CreateTablet for tablet c408a683de314eab8bd0b602ca317d9f (DEFAULT_TABLE table=test-table [id=0fc069d5235f43679c3433ca4ddd7aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:04.256969 19738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c408a683de314eab8bd0b602ca317d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:04.256982 19596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c408a683de314eab8bd0b602ca317d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:04.256989 19884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c408a683de314eab8bd0b602ca317d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:04.262797 19972 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Bootstrap starting.
I20260809 07:59:04.264511 19974 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: Bootstrap starting.
I20260809 07:59:04.265646 19972 tablet_bootstrap.cc:654] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:04.265913 19973 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Bootstrap starting.
I20260809 07:59:04.266539 19972 log.cc:824] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:04.266594 19974 tablet_bootstrap.cc:654] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:04.267431 19974 log.cc:824] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:04.268014 19973 tablet_bootstrap.cc:654] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:04.268683 19972 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: No bootstrap required, opened a new log
I20260809 07:59:04.268893 19972 ts_tablet_manager.cc:1397] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:59:04.269295 19973 log.cc:824] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:04.269443 19974 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: No bootstrap required, opened a new log
I20260809 07:59:04.269639 19974 ts_tablet_manager.cc:1397] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 07:59:04.271155 19973 tablet_bootstrap.cc:492] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: No bootstrap required, opened a new log
I20260809 07:59:04.271334 19973 ts_tablet_manager.cc:1397] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260809 07:59:04.272739 19972 raft_consensus.cc:348] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.273010 19972 raft_consensus.cc:374] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:04.273069 19972 raft_consensus.cc:729] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1452056da0c34df3be7d3cde44ab0ffc, State: Initialized, Role: FOLLOWER
I20260809 07:59:04.273171 19974 raft_consensus.cc:348] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.273445 19974 raft_consensus.cc:374] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:04.273509 19974 raft_consensus.cc:729] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f0e3e39b954e45bd62bfcb852ed72e, State: Initialized, Role: FOLLOWER
I20260809 07:59:04.273535 19972 consensus_queue.cc:260] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.274029 19974 consensus_queue.cc:260] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.274251 19808 heartbeater.cc:503] Master 127.8.51.126:42183 was elected leader, sending a full tablet report...
I20260809 07:59:04.274595 19972 ts_tablet_manager.cc:1428] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:59:04.274967 19974 ts_tablet_manager.cc:1428] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 07:59:04.275000 19973 raft_consensus.cc:348] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.275167 19973 raft_consensus.cc:374] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:04.275206 19973 raft_consensus.cc:729] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bee3814deb4f14b42653a45cbb563d, State: Initialized, Role: FOLLOWER
I20260809 07:59:04.275280 19665 heartbeater.cc:503] Master 127.8.51.126:42183 was elected leader, sending a full tablet report...
I20260809 07:59:04.275604 19973 consensus_queue.cc:260] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.276227 19954 heartbeater.cc:503] Master 127.8.51.126:42183 was elected leader, sending a full tablet report...
I20260809 07:59:04.276476 19973 ts_tablet_manager.cc:1428] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260809 07:59:04.404549 19979 raft_consensus.cc:482] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:59:04.404825 19979 raft_consensus.cc:504] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.406049 19979 leader_election.cc:288] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bee3814deb4f14b42653a45cbb563d (127.8.51.67:43763), 1452056da0c34df3be7d3cde44ab0ffc (127.8.51.66:44867)
I20260809 07:59:04.406046 19981 raft_consensus.cc:482] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:59:04.406276 19981 raft_consensus.cc:504] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.407713 19981 leader_election.cc:288] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f0e3e39b954e45bd62bfcb852ed72e (127.8.51.65:44253), 1452056da0c34df3be7d3cde44ab0ffc (127.8.51.66:44867)
I20260809 07:59:04.411435 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.406489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:44219 (local address 127.8.51.66:44867)
0809 07:59:04.406617 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.406622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.406831 (+ 209us) server_negotiation.cc:407] Connection header received
0809 07:59:04.407076 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.407081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.407139 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.407188 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.407648 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.408404 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410006 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410603 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410683 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.410761 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.411185 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.411272 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 07:59:04.411463 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.406282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:43763 (local address 127.8.51.65:41331)
0809 07:59:04.406916 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.406928 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.407019 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.407295 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.407302 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.407325 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.407516 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.407521 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.408735 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.408739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.409881 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.409886 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410865 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.411007 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.411055 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.411221 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.411285 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":343,"spinlock_wait_cycles":11904,"thread_start_us":130,"threads_started":1}
I20260809 07:59:04.411787 19966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.406364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:41331 (local address 127.8.51.67:43763)
0809 07:59:04.406473 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.406477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.407026 (+ 549us) server_negotiation.cc:407] Connection header received
0809 07:59:04.407112 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.407115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.407167 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.407259 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.407922 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.408605 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410006 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410664 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410746 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.410803 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.411174 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.411685 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":510,"server-negotiator.queue_time_us":31}
I20260809 07:59:04.411796 19982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.406282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44867 (local address 127.8.51.65:44219)
0809 07:59:04.406717 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.406734 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.406937 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.407344 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.407348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.407371 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.407511 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.407518 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.408532 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.408536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.409865 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.409875 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410865 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.411046 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.411064 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.411577 (+ 513us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.411658 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":29,"spinlock_wait_cycles":768,"thread_start_us":104,"threads_started":1}
I20260809 07:59:04.412371 19760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1452056da0c34df3be7d3cde44ab0ffc" is_pre_election: true
I20260809 07:59:04.412693 19760 raft_consensus.cc:2454] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f0e3e39b954e45bd62bfcb852ed72e in term 0.
I20260809 07:59:04.412750 19906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bee3814deb4f14b42653a45cbb563d" is_pre_election: true
I20260809 07:59:04.412938 19906 raft_consensus.cc:2454] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f0e3e39b954e45bd62bfcb852ed72e in term 0.
I20260809 07:59:04.413230 19541 leader_election.cc:302] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1452056da0c34df3be7d3cde44ab0ffc, 36f0e3e39b954e45bd62bfcb852ed72e; no voters:
I20260809 07:59:04.413497 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.408580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:56121 (local address 127.8.51.65:44253)
0809 07:59:04.408695 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.408701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.408714 (+ 13us) server_negotiation.cc:407] Connection header received
0809 07:59:04.408753 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.408756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.408801 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.408867 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.409205 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.409933 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.411462 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.412067 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.412154 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.412200 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.413337 (+ 1137us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.413400 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 07:59:04.413529 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.408154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44867 (local address 127.8.51.67:47829)
0809 07:59:04.408655 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.408668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.408752 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.409211 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.409214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.409230 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.409321 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.409326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410374 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.411470 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.411478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.412927 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.412934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.413120 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.413146 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.413226 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.413290 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260809 07:59:04.413681 19979 raft_consensus.cc:2781] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:59:04.413708 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.408307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:47829 (local address 127.8.51.66:44867)
0809 07:59:04.408993 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.409002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.409012 (+ 10us) server_negotiation.cc:407] Connection header received
0809 07:59:04.409048 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.409052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.409088 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.409418 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:04.409515 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410258 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.412046 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.412681 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.412787 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.412840 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.413476 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.413550 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":126,"threads_started":1}
I20260809 07:59:04.413762 19979 raft_consensus.cc:482] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:59:04.413816 19979 raft_consensus.cc:3037] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:04.413815 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.407880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44253 (local address 127.8.51.67:56121)
0809 07:59:04.408016 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.408029 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:04.408103 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:04.408964 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:04.408967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:04.408981 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:04.409083 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.409088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.410056 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.410059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.411296 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:04.411306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.412950 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.412955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:04.413063 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.413084 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 07:59:04.413154 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 07:59:04.413248 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":4}
I20260809 07:59:04.414363 19760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "a1bee3814deb4f14b42653a45cbb563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1452056da0c34df3be7d3cde44ab0ffc" is_pre_election: true
I20260809 07:59:04.414480 19760 raft_consensus.cc:2454] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1bee3814deb4f14b42653a45cbb563d in term 0.
I20260809 07:59:04.414455 19617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "a1bee3814deb4f14b42653a45cbb563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" is_pre_election: true
I20260809 07:59:04.414870 19834 leader_election.cc:302] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1452056da0c34df3be7d3cde44ab0ffc, a1bee3814deb4f14b42653a45cbb563d; no voters:
I20260809 07:59:04.415102 19981 raft_consensus.cc:2781] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:59:04.415194 19981 raft_consensus.cc:482] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:59:04.415261 19981 raft_consensus.cc:3037] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:04.415529 19979 raft_consensus.cc:504] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.415781 19617 raft_consensus.cc:2379] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1bee3814deb4f14b42653a45cbb563d in current term 1: Already voted for candidate 36f0e3e39b954e45bd62bfcb852ed72e in this term.
I20260809 07:59:04.416198 19906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bee3814deb4f14b42653a45cbb563d"
I20260809 07:59:04.416225 19760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1452056da0c34df3be7d3cde44ab0ffc"
I20260809 07:59:04.416343 19760 raft_consensus.cc:3037] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:04.416483 19981 raft_consensus.cc:504] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.416812 19981 leader_election.cc:288] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [CANDIDATE]: Term 1 election: Requested vote from peers 36f0e3e39b954e45bd62bfcb852ed72e (127.8.51.65:44253), 1452056da0c34df3be7d3cde44ab0ffc (127.8.51.66:44867)
I20260809 07:59:04.416981 19906 raft_consensus.cc:2379] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f0e3e39b954e45bd62bfcb852ed72e in current term 1: Already voted for candidate a1bee3814deb4f14b42653a45cbb563d in this term.
I20260809 07:59:04.417268 19617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "a1bee3814deb4f14b42653a45cbb563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f0e3e39b954e45bd62bfcb852ed72e"
I20260809 07:59:04.417308 19759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c408a683de314eab8bd0b602ca317d9f" candidate_uuid: "a1bee3814deb4f14b42653a45cbb563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1452056da0c34df3be7d3cde44ab0ffc"
I20260809 07:59:04.417426 19617 raft_consensus.cc:2379] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1bee3814deb4f14b42653a45cbb563d in current term 1: Already voted for candidate 36f0e3e39b954e45bd62bfcb852ed72e in this term.
I20260809 07:59:04.417656 19760 raft_consensus.cc:2454] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f0e3e39b954e45bd62bfcb852ed72e in term 1.
I20260809 07:59:04.417834 19834 leader_election.cc:302] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1bee3814deb4f14b42653a45cbb563d; no voters: 1452056da0c34df3be7d3cde44ab0ffc, 36f0e3e39b954e45bd62bfcb852ed72e
I20260809 07:59:04.417891 19541 leader_election.cc:302] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1452056da0c34df3be7d3cde44ab0ffc, 36f0e3e39b954e45bd62bfcb852ed72e; no voters: a1bee3814deb4f14b42653a45cbb563d
I20260809 07:59:04.417899 19979 leader_election.cc:288] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [CANDIDATE]: Term 1 election: Requested vote from peers a1bee3814deb4f14b42653a45cbb563d (127.8.51.67:43763), 1452056da0c34df3be7d3cde44ab0ffc (127.8.51.66:44867)
I20260809 07:59:04.417990 19981 raft_consensus.cc:2726] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 07:59:04.418036 19979 raft_consensus.cc:2781] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:04.418105 19979 raft_consensus.cc:686] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [term 1 LEADER]: Becoming Leader. State: Replica: 36f0e3e39b954e45bd62bfcb852ed72e, State: Running, Role: LEADER
I20260809 07:59:04.418406 19979 consensus_queue.cc:237] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } }
I20260809 07:59:04.421314 19457 catalog_manager.cc:5495] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f0e3e39b954e45bd62bfcb852ed72e (127.8.51.65). New cstate: current_term: 1 leader_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36f0e3e39b954e45bd62bfcb852ed72e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 } health_report { overall_health: UNKNOWN } } }
I20260809 07:59:04.444067 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.440780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52056 (local address 127.8.51.65:44253)
0809 07:59:04.440943 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:04.440948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:04.440962 (+ 14us) server_negotiation.cc:407] Connection header received
0809 07:59:04.441116 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:04.441119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:04.441183 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:04.441271 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:59:04.441495 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.442057 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.442874 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:04.443073 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:04.443153 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:04.443413 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:59:04.443789 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:59:04.443874 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:04.443926 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 07:59:04.443968 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 07:59:04.447110 19955 tablet.cc:2369] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:59:04.449913 19906 raft_consensus.cc:1261] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Refusing update from remote peer 36f0e3e39b954e45bd62bfcb852ed72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:59:04.449939 19760 raft_consensus.cc:1261] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 1 FOLLOWER]: Refusing update from remote peer 36f0e3e39b954e45bd62bfcb852ed72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:59:04.450554 19979 consensus_queue.cc:1035] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bee3814deb4f14b42653a45cbb563d" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:59:04.450774 19986 consensus_queue.cc:1035] T c408a683de314eab8bd0b602ca317d9f P 36f0e3e39b954e45bd62bfcb852ed72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1452056da0c34df3be7d3cde44ab0ffc" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:59:04.458694 19991 mvcc.cc:205] Tried to move back new op lower bound from 7316530562859761664 to 7316530562739965952. Current Snapshot: MvccSnapshot[applied={T|T < 7316530562859761664}]
I20260809 07:59:04.460150 19990 mvcc.cc:205] Tried to move back new op lower bound from 7316530562859761664 to 7316530562739965952. Current Snapshot: MvccSnapshot[applied={T|T < 7316530562859761664 or (T in {7316530562859761664})}]
I20260809 07:59:04.467356 19457 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:59:04.467535 19457 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:59:04.470081 19457 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a10f14ce94ad416eb9dce15f4e228d9e: Sending DeleteTablet for 3 replicas of tablet c408a683de314eab8bd0b602ca317d9f
I20260809 07:59:04.470917 19738 tablet_service.cc:1514] Processing DeleteTablet for tablet c408a683de314eab8bd0b602ca317d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:59:04 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:60292
I20260809 07:59:04.470945 19884 tablet_service.cc:1514] Processing DeleteTablet for tablet c408a683de314eab8bd0b602ca317d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:59:04 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:57930
I20260809 07:59:04.471457 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19523
I20260809 07:59:04.474452 20000 tablet_replica.cc:330] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: stopping tablet replica
I20260809 07:59:04.474855 20000 raft_consensus.cc:2229] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:59:04.475201 20000 raft_consensus.cc:2258] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:59:04.475621 20001 tablet_replica.cc:330] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: stopping tablet replica
I20260809 07:59:04.475931 20001 raft_consensus.cc:2229] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:59:04.476217 20001 raft_consensus.cc:2258] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:59:04.476941 20000 ts_tablet_manager.cc:1905] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:59:04.477626 20001 ts_tablet_manager.cc:1905] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:59:04.479897 20000 ts_tablet_manager.cc:1918] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:59:04.479995 20000 log.cc:1196] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/c408a683de314eab8bd0b602ca317d9f
I20260809 07:59:04.480399 20000 ts_tablet_manager.cc:1939] T c408a683de314eab8bd0b602ca317d9f P a1bee3814deb4f14b42653a45cbb563d: Deleting consensus metadata
I20260809 07:59:04.480407 20001 ts_tablet_manager.cc:1918] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:59:04.480494 20001 log.cc:1196] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/c408a683de314eab8bd0b602ca317d9f
W20260809 07:59:04.480669 19443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:44253 (error 108)
I20260809 07:59:04.481333 20001 ts_tablet_manager.cc:1939] T c408a683de314eab8bd0b602ca317d9f P 1452056da0c34df3be7d3cde44ab0ffc: Deleting consensus metadata
I20260809 07:59:04.481762 19970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.481453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44253 (local address 127.0.0.1:52062)
0809 07:59:04.481564 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.481661 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:44253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 07:59:04.481895 19442 catalog_manager.cc:4841] TS a1bee3814deb4f14b42653a45cbb563d (127.8.51.67:43763): tablet c408a683de314eab8bd0b602ca317d9f (table test-table [id=0fc069d5235f43679c3433ca4ddd7aea]) successfully deleted
W20260809 07:59:04.481927 19443 catalog_manager.cc:4584] TS 36f0e3e39b954e45bd62bfcb852ed72e (127.8.51.65:44253): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c408a683de314eab8bd0b602ca317d9f: Network error: Client connection negotiation failed: client connection to 127.8.51.65:44253: connect: Connection refused (error 111)
I20260809 07:59:04.482197 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19670
I20260809 07:59:04.490231 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19814
I20260809 07:59:04.491724 19970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:04.490421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44867 (local address 127.0.0.1:60306)
0809 07:59:04.491589 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:04.491643 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.66:44867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1089}
I20260809 07:59:04.498857 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 19422
2026-08-09T07:59:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2382 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:59:04 dist-test-slave-njxd krb5kdc[20005](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:59:04 dist-test-slave-njxd krb5kdc[20005](info): set up 2 sockets
Aug 09 07:59:04 dist-test-slave-njxd krb5kdc[20005](info): commencing operation
krb5kdc: starting...
W20260809 07:59:05.569021 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:59:05 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:59:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:59:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangeradmin_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangeradmin_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangerlookup_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangerlookup_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
I20260809 07:59:05.740167 8397 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzQyOdB/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/postgres -l logfile start
2026-08-09 07:59:08.064 UTC [20040] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 07:59:08.065 UTC [20040] LOG: listening on IPv4 address "127.8.51.84", port 39283
2026-08-09 07:59:08.068 UTC [20040] LOG: listening on Unix socket "/tmp/.s.PGSQL.39283"
2026-08-09 07:59:08.089 UTC [20044] LOG: database system was shut down at 2026-08-09 07:59:06 UTC
2026-08-09 07:59:08.093 UTC [20040] LOG: database system is ready to accept connections
I20260809 07:59:09.063894 8397 mini_postgres.cc:96] Postgres bound to 39283
2026-08-09 07:59:09.072 UTC [20054] FATAL: database "slave" does not exist
127.8.51.84:39283 - accepting connections
I20260809 07:59:09.073774 8397 mini_ranger.cc:161] Starting Ranger...
I20260809 07:59:09.092967 8397 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 07:59:09.526342 8397 mini_ranger.cc:87] Created ranger Postgres database
I20260809 07:59:09.526463 8397 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin
2026-08-09 07:59:09,865 [I] DB FLAVOR :POSTGRES
2026-08-09 07:59:09,866 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 07:59:09,866 [I] Checking connection..
2026-08-09 07:59:09,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 07:59:10,121 [I] Checking connection passed.
2026-08-09 07:59:10,121 [I] --------- Verifying version history table ---------
2026-08-09 07:59:10,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:10,380 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 07:59:10,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:10,642 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 07:59:10,642 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 07:59:10,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 07:59:10.891 UTC [20123] WARNING: there is no transaction in progress
2026-08-09 07:59:10,897 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 07:59:10,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:11,145 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 07:59:11,146 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 07:59:11,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 07:59:11,383 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 07:59:11,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-09 07:59:11,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 07:59:12,124 [I] Table x_portal_user does not exist in database ranger
2026-08-09 07:59:12,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 07:59:12,354 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 07:59:12,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 07:59:12,594 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 07:59:12,848 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 07:59:12,848 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 07:59:13.733 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.748 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.763 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.778 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.792 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.809 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.871 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.878 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.891 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.901 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.910 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.923 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.932 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.938 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.944 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:13.950 UTC [20239] WARNING: there is no transaction in progress
2026-08-09 07:59:14,531 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 07:59:14,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 07:59:14,772 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 07:59:14,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 07:59:15,011 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 07:59:15,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 07:59:15,247 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 07:59:15,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 07:59:15,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 07:59:15,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-09 07:59:15,997 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 07:59:15,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 07:59:16,256 [I] DB_PATCHES have already been applied
I20260809 07:59:16.261854 8397 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzQyOdB/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 07:59:16.261919 8397 mini_ranger.cc:193] Using host: 127.8.51.84
I20260809 07:59:16.266121 8397 mini_ranger.cc:227] Ranger admin URL: http://127.8.51.84:35951
Aug 09, 2026 7:59:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:59:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:59:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 7:59:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 7:59:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 7:59:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 7:59:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 07:59:17.406579 8397 mini_ranger.cc:160] Time spent starting Ranger: real 8.333s user 0.002s sys 0.010s
Aug 09, 2026 7:59:37 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 7:59:37 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 7:59:37 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 7:59:37 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 7:59:38 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 07:59:38.772009 8397 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangerkms_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/rangerkms_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.51.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.51.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 07:59:38 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262378, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 07:59:38.860821 8397 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 07:59:38.870556 8397 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 07:59:39.758364 8397 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 07:59:39.758462 8397 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms
I20260809 07:59:39.758582 8397 mini_ranger_kms.cc:227] Using postgres at 127.8.51.84:39283
2026-08-09 07:59:40,426 [I] DB FLAVOR :POSTGRES
2026-08-09 07:59:40,426 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 07:59:40,426 [I] Checking connection
2026-08-09 07:59:40,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 07:59:40,688 [I] connection success
2026-08-09 07:59:40,688 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 07:59:40,688 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 07:59:40,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 07:59:40,933 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 07:59:40,933 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 07:59:40,933 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 07:59:40,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:39283/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 07:59:41,184 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 07:59:41.657910 8397 mini_ranger_kms.cc:310] Created kms service
I20260809 07:59:41.858063 8397 mini_ranger_kms.cc:326] Created kudu user
I20260809 07:59:41.901202 8397 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 07:59:41 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262378, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:42.270951 8397 mini_ranger_kms.cc:384] Added ranger policy
I20260809 07:59:42.271116 8397 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 07:59:42.271145 8397 mini_ranger_kms.cc:240] Using host: 127.8.51.84
I20260809 07:59:42.276544 8397 mini_ranger_kms.cc:276] Ranger KMS PID: 20435
I20260809 07:59:42.276686 8397 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.51.84:52833
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 7:59:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 07:59:44.549773 8397 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.689s user 0.021s sys 0.282s
I20260809 07:59:44.549916 8397 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 07:59:44.550050 8397 mini_ranger_kms.cc:401] 127.8.51.84:52833/kms/v1/keys
Aug 09 07:59:44 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786262384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 07:59:45 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
Aug 09 07:59:45 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
Aug 09 07:59:47 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 07:59:47.732906 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45345
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45345
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:52833/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:47.846988 20493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:47.847257 20493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:47.847296 20493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:47.851264 20493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 07:59:47.851327 20493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:47.851346 20493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:47.851361 20493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 07:59:47.851375 20493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 07:59:47.856897 20493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.51.84:52833/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45345
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:47.858027 20493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:47.859149 20493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 07:59:47.868464 20493 server_base.cc:1034] running on GCE node
W20260809 07:59:47.868489 20499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:47.868491 20500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:47.868490 20502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:47.869378 20493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:47.870594 20493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:47.871769 20493 hybrid_clock.cc:648] HybridClock initialized: now 1786262387871743 us; error 41 us; skew 500 ppm
Aug 09 07:59:47 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262387, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:47.874763 20493 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 07:59:47.875734 20493 webserver.cc:460] Webserver started at http://127.8.51.126:35813/ using document root <none> and password file <none>
I20260809 07:59:47.876312 20493 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:47.876400 20493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:47.876638 20493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 07:59:47 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262387, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:47.927318 20493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "015cb67cf2304974a0aca388c8c02bdd"
format_stamp: "Formatted at 2026-08-09 07:59:47 on dist-test-slave-njxd"
server_key: "32b7d5ce1db24ab4e345875963912461"
server_key_iv: "cb581ffd9695339fe63a11c1656b43b5"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:47.928028 20493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "015cb67cf2304974a0aca388c8c02bdd"
format_stamp: "Formatted at 2026-08-09 07:59:47 on dist-test-slave-njxd"
server_key: "32b7d5ce1db24ab4e345875963912461"
server_key_iv: "cb581ffd9695339fe63a11c1656b43b5"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:47.932646 20493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 07:59:47.947736 20509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:47.949247 20493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 07:59:47.949363 20493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "015cb67cf2304974a0aca388c8c02bdd"
format_stamp: "Formatted at 2026-08-09 07:59:47 on dist-test-slave-njxd"
server_key: "32b7d5ce1db24ab4e345875963912461"
server_key_iv: "cb581ffd9695339fe63a11c1656b43b5"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:47.949524 20493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:47.966521 20493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:47.969750 20493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:47.970244 20493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:47.979060 20493 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45345
I20260809 07:59:47.979179 20563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45345 every 8 connection(s)
I20260809 07:59:47.980043 20493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 07:59:47.981598 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 20493
I20260809 07:59:47.981721 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 07:59:47.982043 8397 external_mini_cluster.cc:1428] Setting key 189dffe43798609ec96fad7349bb0e4b
I20260809 07:59:47.983213 20564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:47.990717 20564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: Bootstrap starting.
Aug 09 07:59:47 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:47.993443 20564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:47.994625 20564 log.cc:824] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:47.996713 20564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: No bootstrap required, opened a new log
I20260809 07:59:48.000382 20567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:47.983699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38712 (local address 127.8.51.126:45345)
0809 07:59:47.984171 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:47.984191 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:47.984440 (+ 249us) server_negotiation.cc:407] Connection header received
0809 07:59:47.985361 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:47.985384 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:47.985825 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:47.986198 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:47.987149 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:47.988781 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:47.990039 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:47.990682 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:47.990913 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:47.994088 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:47.994095 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:47.994113 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:47.994144 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:47.996963 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:47.997630 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:47.997636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:47.997642 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:47.997772 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:47.998108 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:47.998111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:47.998112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:47.998595 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:47.998878 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:47.999133 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 07:59:47.999409 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":148,"threads_started":1}
I20260809 07:59:48.000967 20564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } }
I20260809 07:59:48.001237 20564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:48.001322 20564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 015cb67cf2304974a0aca388c8c02bdd, State: Initialized, Role: FOLLOWER
I20260809 07:59:48.001816 20564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } }
I20260809 07:59:48.001983 20564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 07:59:48.002077 20564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 07:59:48.002197 20564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:48.003302 20564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } }
I20260809 07:59:48.003620 20564 leader_election.cc:302] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 015cb67cf2304974a0aca388c8c02bdd; no voters:
I20260809 07:59:48.003906 20564 leader_election.cc:288] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 07:59:48.004022 20569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:48.004235 20569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [term 1 LEADER]: Becoming Leader. State: Replica: 015cb67cf2304974a0aca388c8c02bdd, State: Running, Role: LEADER
I20260809 07:59:48.004578 20569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } }
I20260809 07:59:48.005160 20564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 07:59:48.006388 20570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "015cb67cf2304974a0aca388c8c02bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } } }
I20260809 07:59:48.006506 20570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:48.006886 20571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 015cb67cf2304974a0aca388c8c02bdd. Latest consensus state: current_term: 1 leader_uuid: "015cb67cf2304974a0aca388c8c02bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cb67cf2304974a0aca388c8c02bdd" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45345 } } }
I20260809 07:59:48.007066 20571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd [sys.catalog]: This master's current role is: LEADER
I20260809 07:59:48.007962 20564 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 07:59:48.008340 20578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 07:59:48.014707 20578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 07:59:48.023370 20578 catalog_manager.cc:1347] Generated new cluster ID: 1c4721cbf73544eda961d6f5281d997c
I20260809 07:59:48.023432 20578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 07:59:48.038205 20578 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 07:59:48.039501 20578 catalog_manager.cc:1504] Loading token signing keys...
I20260809 07:59:48.048542 20578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: Generated new TSK 0
I20260809 07:59:48.049512 20578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 07:59:48.761426 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:52833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:48.900362 20613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:48.900733 20613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:48.900801 20613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:48.906637 20613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:48.906713 20613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:48.906790 20613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 07:59:48.912204 20613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.51.84:52833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:48.913389 20613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:48.914894 20613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:48.926621 20622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:48.926721 20621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:48.927026 20624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:48.927312 20613 server_base.cc:1034] running on GCE node
I20260809 07:59:48.927906 20613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:48.928696 20613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:48.929893 20613 hybrid_clock.cc:648] HybridClock initialized: now 1786262388929868 us; error 34 us; skew 500 ppm
Aug 09 07:59:48 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262388, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:48.933398 20613 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 07:59:48.934387 20613 webserver.cc:460] Webserver started at http://127.8.51.65:41267/ using document root <none> and password file <none>
I20260809 07:59:48.935010 20613 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:48.935071 20613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:48.935313 20613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 07:59:48 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262388, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:48.952004 20613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "ba4097ebbbfa4b2ab796332ed4392347"
format_stamp: "Formatted at 2026-08-09 07:59:48 on dist-test-slave-njxd"
server_key: "8d04e2a0e777a76b729a74b0e247d640"
server_key_iv: "38a08c2d898c389a7fa440ae5a2d7a4a"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:48.952838 20613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "ba4097ebbbfa4b2ab796332ed4392347"
format_stamp: "Formatted at 2026-08-09 07:59:48 on dist-test-slave-njxd"
server_key: "8d04e2a0e777a76b729a74b0e247d640"
server_key_iv: "38a08c2d898c389a7fa440ae5a2d7a4a"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:48.969687 20613 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.005s sys 0.000s
I20260809 07:59:48.994028 20632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:48.995559 20613 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.000s
I20260809 07:59:48.995723 20613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "ba4097ebbbfa4b2ab796332ed4392347"
format_stamp: "Formatted at 2026-08-09 07:59:48 on dist-test-slave-njxd"
server_key: "8d04e2a0e777a76b729a74b0e247d640"
server_key_iv: "38a08c2d898c389a7fa440ae5a2d7a4a"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:48.996299 20613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:49.029697 20613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:49.033531 20613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:49.033823 20613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:49.034677 20613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:49.035775 20613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:49.036094 20613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.036237 20613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:49.036326 20613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.051045 20613 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:41041
I20260809 07:59:49.052291 20613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 07:59:49.054117 20756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:41041 every 8 connection(s)
I20260809 07:59:49.059613 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 20613
I20260809 07:59:49.059757 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 07:59:49.060091 8397 external_mini_cluster.cc:1428] Setting key a72ec88acd5d8d4158b05e9ac86dfc6a
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262388, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:49.071398 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.056336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:51045 (local address 127.8.51.126:45345)
0809 07:59:49.056623 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.056628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.057689 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 07:59:49.058956 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.058960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.059018 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.059081 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:49.060910 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.061726 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.063521 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.063919 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.063998 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.066928 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:49.066932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:49.066935 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:49.066958 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:49.068714 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.069305 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.069308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.069311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.069427 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.069923 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.069929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.069932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.070177 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:49.070259 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.071015 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.071162 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
I20260809 07:59:49.073395 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.056822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45345 (local address 127.8.51.65:51045)
0809 07:59:49.057469 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.057541 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.058689 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.059490 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.059501 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.060002 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:49.060739 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.060758 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.061892 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.061895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.063371 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.063386 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.064218 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.064221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.064399 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.065089 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:49.065108 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:49.066753 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:49.068858 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.068863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.068877 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.069188 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.069564 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.069569 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.069603 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.069797 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.070350 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:49.070358 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:49.070710 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.071884 (+ 1174us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.072267 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":192,"threads_started":1}
I20260809 07:59:49.078466 20757 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45345
I20260809 07:59:49.078706 20757 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:49.079243 20757 heartbeater.cc:511] Master 127.8.51.126:45345 requested a full tablet report, sending...
I20260809 07:59:49.081159 20524 ts_manager.cc:194] Registered new tserver with Master: ba4097ebbbfa4b2ab796332ed4392347 (127.8.51.65:41041)
I20260809 07:59:49.082842 20524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:51045
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 07:59:49.121832 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:52833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 07:59:49.291247 20764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:49.291568 20764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:49.291692 20764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:49.297780 20764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:49.297952 20764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:49.298094 20764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 07:59:49.306272 20764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.51.84:52833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:49.307880 20764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:49.309312 20764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:49.322240 20770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:49.323087 20773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:49.323338 20764 server_base.cc:1034] running on GCE node
W20260809 07:59:49.325737 20771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:49.326414 20764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:49.327255 20764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:49.330695 20764 hybrid_clock.cc:648] HybridClock initialized: now 1786262389330659 us; error 56 us; skew 500 ppm
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:49.334573 20764 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 07:59:49.335780 20764 webserver.cc:460] Webserver started at http://127.8.51.66:45329/ using document root <none> and password file <none>
I20260809 07:59:49.336578 20764 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:49.336741 20764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:49.337026 20764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:49.361430 20764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "e7c502be7be12e9e616198494630e212"
server_key_iv: "da74b8e3c55dd2c0fbaea82a49276ebb"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.363730 20764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "e7c502be7be12e9e616198494630e212"
server_key_iv: "da74b8e3c55dd2c0fbaea82a49276ebb"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.369038 20764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 07:59:49.393954 20780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.395820 20764 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.000s
I20260809 07:59:49.396055 20764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "e7c502be7be12e9e616198494630e212"
server_key_iv: "da74b8e3c55dd2c0fbaea82a49276ebb"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.396292 20764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:49.417747 20764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:49.421296 20764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:49.421542 20764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:49.422339 20764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:49.423444 20764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:49.423543 20764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.423656 20764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:49.423727 20764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.438555 20764 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:36137
I20260809 07:59:49.438887 20903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:36137 every 8 connection(s)
I20260809 07:59:49.439673 20764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 07:59:49.449432 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 20764
I20260809 07:59:49.449553 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 07:59:49.449837 8397 external_mini_cluster.cc:1428] Setting key cdef289451cb04b44b4bb2636c1ac838
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 07:59:49.465104 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.447458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36697 (local address 127.8.51.126:45345)
0809 07:59:49.447613 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.447618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.448862 (+ 1244us) server_negotiation.cc:407] Connection header received
0809 07:59:49.450123 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.450126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.450183 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.450237 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:49.451857 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.452688 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.454496 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.454846 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.454920 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.459685 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:49.459690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:49.459696 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:49.459745 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:49.461841 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.462785 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.462791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.462794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.462902 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.463427 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.463432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.463436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.463711 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:49.463814 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.464686 (+ 872us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.464892 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 07:59:49.467352 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.447931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45345 (local address 127.8.51.66:36697)
0809 07:59:49.448692 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.448753 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.449872 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.450658 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.450666 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.451011 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:49.451688 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.451709 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.452868 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.452871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.454358 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.454369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.455116 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.455120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.455301 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.457865 (+ 2564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:49.457884 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:49.459481 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:49.462019 (+ 2538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.462027 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.462048 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.462563 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.463039 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.463044 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.463047 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.463256 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.463911 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:49.463919 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:49.464295 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.465355 (+ 1060us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.465949 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":287,"threads_started":1}
I20260809 07:59:49.468834 20905 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45345
I20260809 07:59:49.469089 20905 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:49.469789 20905 heartbeater.cc:511] Master 127.8.51.126:45345 requested a full tablet report, sending...
I20260809 07:59:49.478436 20524 ts_manager.cc:194] Registered new tserver with Master: fc07e4c3c05f4bdca57b99174e8cb7ae (127.8.51.66:36137)
I20260809 07:59:49.479175 20524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:36697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 07:59:49.499723 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:52833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
W20260809 07:59:49.670462 20910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 07:59:49.670925 20910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 07:59:49.671041 20910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 07:59:49.676887 20910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 07:59:49.677008 20910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 07:59:49.677150 20910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 07:59:49.684451 20910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.51.84:52833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 07:59:49.686007 20910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 07:59:49.687337 20910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 07:59:49.701313 20919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:49.701957 20917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 07:59:49.702320 20915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 07:59:49.703558 20910 server_base.cc:1034] running on GCE node
I20260809 07:59:49.704058 20910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 07:59:49.704809 20910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 07:59:49.706023 20910 hybrid_clock.cc:648] HybridClock initialized: now 1786262389705954 us; error 82 us; skew 500 ppm
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 07:59:49.709682 20910 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 07:59:49.710842 20910 webserver.cc:460] Webserver started at http://127.8.51.67:40311/ using document root <none> and password file <none>
I20260809 07:59:49.711623 20910 fs_manager.cc:359] Metadata directory not provided
I20260809 07:59:49.711800 20910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 07:59:49.712100 20910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:49.739550 20910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "12ade8ce70f44bf586775cff264bf504"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "192a15198a5e41452e5422e51b368fde"
server_key_iv: "f429361a76df898b1efee01fef763cce"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.740273 20910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "12ade8ce70f44bf586775cff264bf504"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "192a15198a5e41452e5422e51b368fde"
server_key_iv: "f429361a76df898b1efee01fef763cce"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.744534 20910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 07:59:49.761932 20928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.763979 20910 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 07:59:49.764235 20910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "12ade8ce70f44bf586775cff264bf504"
format_stamp: "Formatted at 2026-08-09 07:59:49 on dist-test-slave-njxd"
server_key: "192a15198a5e41452e5422e51b368fde"
server_key_iv: "f429361a76df898b1efee01fef763cce"
server_key_version: "kuduclusterkey@0"
I20260809 07:59:49.764485 20910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 07:59:49.792064 20910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 07:59:49.795686 20910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 07:59:49.795892 20910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 07:59:49.796617 20910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 07:59:49.797709 20910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 07:59:49.797771 20910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.797823 20910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 07:59:49.797851 20910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 07:59:49.808933 20910 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:41233
I20260809 07:59:49.809212 21049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:41233 every 8 connection(s)
I20260809 07:59:49.810177 20910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 07:59:49.819736 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 20910
I20260809 07:59:49.819871 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 07:59:49.820209 8397 external_mini_cluster.cc:1428] Setting key 33003f33a0746b6f047e08cf311ca5f4
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 07:59:49.828085 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.812484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:45885 (local address 127.8.51.126:45345)
0809 07:59:49.812624 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.812629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.814448 (+ 1819us) server_negotiation.cc:407] Connection header received
0809 07:59:49.815677 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.815681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.815738 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.815827 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:49.817315 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.818160 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.819988 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.820372 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.820456 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.824009 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:49.824013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:49.824016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:49.824043 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:49.825795 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.826422 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.826425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.826427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.826510 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.826903 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.826906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.826908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.827115 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:49.827203 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.827827 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.827939 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 07:59:49.829154 21052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.812965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45345 (local address 127.8.51.67:45885)
0809 07:59:49.814240 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.814302 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.815424 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.816156 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.816165 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.816504 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0809 07:59:49.817138 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.817157 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.818298 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.818302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.819813 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.819828 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.820686 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.820690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.820950 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.821791 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 07:59:49.821820 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 07:59:49.823809 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 07:59:49.825918 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.825924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.825941 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.826319 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.826606 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 07:59:49.826609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 07:59:49.826611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 07:59:49.826801 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 07:59:49.827226 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 07:59:49.827233 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 07:59:49.827556 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.827767 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.828101 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1032,"thread_start_us":186,"threads_started":1}
I20260809 07:59:49.830549 21050 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45345
I20260809 07:59:49.830813 21050 heartbeater.cc:464] Registering TS with master...
I20260809 07:59:49.831450 21050 heartbeater.cc:511] Master 127.8.51.126:45345 requested a full tablet report, sending...
I20260809 07:59:49.832592 20524 ts_manager.cc:194] Registered new tserver with Master: 12ade8ce70f44bf586775cff264bf504 (127.8.51.67:41233)
I20260809 07:59:49.833293 20524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:45885
I20260809 07:59:49.835296 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 07:59:49.847466 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.837705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38728 (local address 127.8.51.126:45345)
0809 07:59:49.837838 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.837842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.838502 (+ 660us) server_negotiation.cc:407] Connection header received
0809 07:59:49.838611 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.838614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.838664 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.838759 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 07:59:49.839617 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.840349 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.841621 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.841969 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.842110 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.843768 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 07:59:49.843772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 07:59:49.843775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 07:59:49.843803 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 07:59:49.845553 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.846087 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.846091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.846093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.846175 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 07:59:49.846471 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 07:59:49.846474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 07:59:49.846476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 07:59:49.846670 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 07:59:49.846788 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.847182 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.847301 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 07:59:49.851146 20524 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 07:59:49.855373 20524 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 07:59:49.876505 21066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.867345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36137 (local address 127.0.0.1:48290)
0809 07:59:49.869356 (+ 2011us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.869402 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.869536 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.871154 (+ 1618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.871157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.871174 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:49.871320 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.871327 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.873104 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.873107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.874603 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.874615 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.875978 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.875981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.876105 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.876142 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.876247 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.876355 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1849,"thread_start_us":109,"threads_started":1}
I20260809 07:59:49.877226 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.868882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.8.51.66:36137)
0809 07:59:49.869812 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.869822 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.869845 (+ 23us) server_negotiation.cc:407] Connection header received
0809 07:59:49.869915 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.869920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.870882 (+ 962us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.871059 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:49.871561 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.872943 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.874784 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.875615 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.875744 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.875912 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.876962 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.877069 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":833,"thread_start_us":98,"threads_started":1}
I20260809 07:59:49.879251 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.868121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41041 (local address 127.0.0.1:49438)
0809 07:59:49.869820 (+ 1699us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.869831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.869960 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.870558 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.870563 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.870585 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:49.870708 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.870713 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.871989 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.871992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.876433 (+ 4441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.876442 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.878842 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.878845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.878955 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.878979 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.879060 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.879125 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1645,"thread_start_us":82,"threads_started":1}
I20260809 07:59:49.880755 20833 tablet_service.cc:1467] Processing CreateTablet for tablet 502b24997666453d84566edc7946b200 (DEFAULT_TABLE table=test-table [id=46aa28709cf04656b2aa5fca9d5d4da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:49.881955 20833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502b24997666453d84566edc7946b200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:49.882403 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.868266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49438 (local address 127.8.51.65:41041)
0809 07:59:49.868708 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.868715 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.869902 (+ 1187us) server_negotiation.cc:407] Connection header received
0809 07:59:49.870091 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.870097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.870281 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.870388 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:49.870828 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.871842 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.877122 (+ 5280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.877968 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.878045 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.878187 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.882160 (+ 3973us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.882265 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":138,"threads_started":1}
I20260809 07:59:49.884784 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.868392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:41233 (local address 127.0.0.1:58562)
0809 07:59:49.874125 (+ 5733us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.874137 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.874221 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.874888 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.874891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.874907 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:49.874999 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.875004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.876530 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.876532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.880252 (+ 3720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.880266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.884411 (+ 4145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.884415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.884509 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.884530 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.884596 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.884661 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5664,"thread_start_us":72,"threads_started":1}
I20260809 07:59:49.885224 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.868890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.8.51.67:41233)
0809 07:59:49.869312 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.869323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.874303 (+ 4980us) server_negotiation.cc:407] Connection header received
0809 07:59:49.874378 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.874383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.874620 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.874757 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:49.875143 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.876253 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.883327 (+ 7074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.884115 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.884226 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.884349 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.884991 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.885095 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":132,"threads_started":1}
I20260809 07:59:49.885200 20685 tablet_service.cc:1467] Processing CreateTablet for tablet 502b24997666453d84566edc7946b200 (DEFAULT_TABLE table=test-table [id=46aa28709cf04656b2aa5fca9d5d4da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:49.886319 20685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502b24997666453d84566edc7946b200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:49.887789 20959 tablet_service.cc:1467] Processing CreateTablet for tablet 502b24997666453d84566edc7946b200 (DEFAULT_TABLE table=test-table [id=46aa28709cf04656b2aa5fca9d5d4da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 07:59:49.888736 20959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502b24997666453d84566edc7946b200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 07:59:49.891829 21069 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Bootstrap starting.
I20260809 07:59:49.894134 21069 tablet_bootstrap.cc:654] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:49.895507 21069 log.cc:824] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:49.896261 21071 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Bootstrap starting.
I20260809 07:59:49.899523 21069 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: No bootstrap required, opened a new log
I20260809 07:59:49.899832 21069 ts_tablet_manager.cc:1397] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 07:59:49.900997 21071 tablet_bootstrap.cc:654] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:49.901244 21070 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Bootstrap starting.
I20260809 07:59:49.902001 21071 log.cc:824] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:49.903539 21070 tablet_bootstrap.cc:654] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Neither blocks nor log segments found. Creating new log.
I20260809 07:59:49.904374 21070 log.cc:824] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Log is configured to *not* fsync() on all Append() calls
I20260809 07:59:49.904235 21069 raft_consensus.cc:348] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.904829 21069 raft_consensus.cc:374] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:49.904942 21069 raft_consensus.cc:729] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc07e4c3c05f4bdca57b99174e8cb7ae, State: Initialized, Role: FOLLOWER
I20260809 07:59:49.905515 21069 consensus_queue.cc:260] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.906512 21070 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: No bootstrap required, opened a new log
I20260809 07:59:49.906710 21070 ts_tablet_manager.cc:1397] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 07:59:49.906720 21069 ts_tablet_manager.cc:1428] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 07:59:49.907061 20905 heartbeater.cc:503] Master 127.8.51.126:45345 was elected leader, sending a full tablet report...
I20260809 07:59:49.910921 21070 raft_consensus.cc:348] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.911207 21070 raft_consensus.cc:374] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:49.911273 21070 raft_consensus.cc:729] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4097ebbbfa4b2ab796332ed4392347, State: Initialized, Role: FOLLOWER
I20260809 07:59:49.911898 21070 consensus_queue.cc:260] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.913035 21070 ts_tablet_manager.cc:1428] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 07:59:49.913518 20757 heartbeater.cc:503] Master 127.8.51.126:45345 was elected leader, sending a full tablet report...
I20260809 07:59:49.914023 21071 tablet_bootstrap.cc:492] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: No bootstrap required, opened a new log
I20260809 07:59:49.914180 21071 ts_tablet_manager.cc:1397] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20260809 07:59:49.918113 21071 raft_consensus.cc:348] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.918358 21071 raft_consensus.cc:374] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 07:59:49.918443 21071 raft_consensus.cc:729] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ade8ce70f44bf586775cff264bf504, State: Initialized, Role: FOLLOWER
I20260809 07:59:49.918895 21071 consensus_queue.cc:260] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.919552 21050 heartbeater.cc:503] Master 127.8.51.126:45345 was elected leader, sending a full tablet report...
I20260809 07:59:49.919911 21071 ts_tablet_manager.cc:1428] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260809 07:59:49.941099 20906 tablet.cc:2369] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 07:59:49 dist-test-slave-njxd krb5kdc[20005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262389, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 07:59:49.982990 21078 raft_consensus.cc:482] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 07:59:49.983208 21078 raft_consensus.cc:504] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.984545 21078 leader_election.cc:288] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc07e4c3c05f4bdca57b99174e8cb7ae (127.8.51.66:36137), ba4097ebbbfa4b2ab796332ed4392347 (127.8.51.65:41041)
I20260809 07:59:49.989464 21052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.984907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36137 (local address 127.8.51.67:54593)
0809 07:59:49.985144 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.985158 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.985245 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.985796 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.985799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.985815 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:49.985932 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.985938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.986906 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.986909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.988034 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.988044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.989099 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.989102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.989206 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.989226 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.989285 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.989344 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260809 07:59:49.990382 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.985005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:54593 (local address 127.8.51.66:36137)
0809 07:59:49.985383 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.985387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.985399 (+ 12us) server_negotiation.cc:407] Connection header received
0809 07:59:49.985445 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.985448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.985487 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.985553 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:49.986075 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.986789 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.988327 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.988891 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.988985 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.989045 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.990205 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.990275 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308}
I20260809 07:59:49.990873 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502b24997666453d84566edc7946b200" candidate_uuid: "12ade8ce70f44bf586775cff264bf504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" is_pre_election: true
I20260809 07:59:49.991138 20854 raft_consensus.cc:2454] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ade8ce70f44bf586775cff264bf504 in term 0.
I20260809 07:59:49.991747 20931 leader_election.cc:302] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ade8ce70f44bf586775cff264bf504, fc07e4c3c05f4bdca57b99174e8cb7ae; no voters:
I20260809 07:59:49.992053 21078 raft_consensus.cc:2781] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 07:59:49.992122 21078 raft_consensus.cc:482] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 07:59:49.992158 21078 raft_consensus.cc:3037] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:49.992231 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.985529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:48255 (local address 127.8.51.65:41041)
0809 07:59:49.985738 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:49.985742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:49.987619 (+ 1877us) server_negotiation.cc:407] Connection header received
0809 07:59:49.987822 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:49.987825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:49.987868 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:49.987909 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 07:59:49.988309 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.989008 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.990981 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.991538 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.991618 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.991682 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:49.992027 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 07:59:49.992119 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260809 07:59:49.992623 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:49.985122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41041 (local address 127.8.51.67:48255)
0809 07:59:49.987541 (+ 2419us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:49.987553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 07:59:49.987709 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 07:59:49.988029 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 07:59:49.988031 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 07:59:49.988044 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 07:59:49.988164 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.988168 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.989458 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.989460 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.990848 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 07:59:49.990859 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 07:59:49.991787 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 07:59:49.991790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 07:59:49.991887 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:49.991906 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 07:59:49.992404 (+ 498us) client_negotiation.cc:240] Negotiation successful
0809 07:59:49.992476 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2359,"thread_start_us":123,"threads_started":1}
I20260809 07:59:49.993278 20697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502b24997666453d84566edc7946b200" candidate_uuid: "12ade8ce70f44bf586775cff264bf504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4097ebbbfa4b2ab796332ed4392347" is_pre_election: true
I20260809 07:59:49.993513 21078 raft_consensus.cc:504] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:49.993564 20697 raft_consensus.cc:2454] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ade8ce70f44bf586775cff264bf504 in term 0.
I20260809 07:59:49.993908 21078 leader_election.cc:288] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [CANDIDATE]: Term 1 election: Requested vote from peers fc07e4c3c05f4bdca57b99174e8cb7ae (127.8.51.66:36137), ba4097ebbbfa4b2ab796332ed4392347 (127.8.51.65:41041)
I20260809 07:59:49.994999 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502b24997666453d84566edc7946b200" candidate_uuid: "12ade8ce70f44bf586775cff264bf504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae"
I20260809 07:59:49.995151 20854 raft_consensus.cc:3037] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:49.996419 20854 raft_consensus.cc:2454] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ade8ce70f44bf586775cff264bf504 in term 1.
I20260809 07:59:49.996824 20697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502b24997666453d84566edc7946b200" candidate_uuid: "12ade8ce70f44bf586775cff264bf504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4097ebbbfa4b2ab796332ed4392347"
I20260809 07:59:49.996939 20697 raft_consensus.cc:3037] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 0 FOLLOWER]: Advancing to term 1
I20260809 07:59:49.998155 20697 raft_consensus.cc:2454] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ade8ce70f44bf586775cff264bf504 in term 1.
I20260809 07:59:49.998512 20931 leader_election.cc:302] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ade8ce70f44bf586775cff264bf504, ba4097ebbbfa4b2ab796332ed4392347; no voters:
I20260809 07:59:49.998811 21078 raft_consensus.cc:2781] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 07:59:49.999035 21078 raft_consensus.cc:686] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 1 LEADER]: Becoming Leader. State: Replica: 12ade8ce70f44bf586775cff264bf504, State: Running, Role: LEADER
I20260809 07:59:49.999373 21078 consensus_queue.cc:237] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } }
I20260809 07:59:50.002841 20524 catalog_manager.cc:5495] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12ade8ce70f44bf586775cff264bf504 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "12ade8ce70f44bf586775cff264bf504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12ade8ce70f44bf586775cff264bf504" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41233 } health_report { overall_health: HEALTHY } } }
I20260809 07:59:50.044211 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:50.036943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.8.51.67:41233)
0809 07:59:50.037100 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 07:59:50.037105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 07:59:50.037836 (+ 731us) server_negotiation.cc:407] Connection header received
0809 07:59:50.038009 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 07:59:50.038013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 07:59:50.038098 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 07:59:50.038211 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 07:59:50.038591 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:50.039321 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:50.040767 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 07:59:50.041079 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 07:59:50.041171 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 07:59:50.042843 (+ 1672us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 07:59:50.043451 (+ 608us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 07:59:50.043567 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 07:59:50.043997 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 07:59:50.044070 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 07:59:50.052642 20697 raft_consensus.cc:1261] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347 [term 1 FOLLOWER]: Refusing update from remote peer 12ade8ce70f44bf586775cff264bf504: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:59:50.054049 20854 raft_consensus.cc:1261] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 1 FOLLOWER]: Refusing update from remote peer 12ade8ce70f44bf586775cff264bf504: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 07:59:50.055066 21078 consensus_queue.cc:1035] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba4097ebbbfa4b2ab796332ed4392347" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 07:59:50.055481 21078 consensus_queue.cc:1035] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc07e4c3c05f4bdca57b99174e8cb7ae" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 07:59:50.055850 20758 tablet.cc:2369] T 502b24997666453d84566edc7946b200 P ba4097ebbbfa4b2ab796332ed4392347: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 07:59:50.066268 21051 tablet.cc:2369] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 07:59:50.072643 21085 mvcc.cc:205] Tried to move back new op lower bound from 7316530749646221312 to 7316530749440761856. Current Snapshot: MvccSnapshot[applied={T|T < 7316530749646221312}]
I20260809 07:59:50.093827 21087 mvcc.cc:205] Tried to move back new op lower bound from 7316530749646221312 to 7316530749440761856. Current Snapshot: MvccSnapshot[applied={T|T < 7316530749646221312}]
I20260809 07:59:50.093909 20526 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:59:50.094089 20526 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 07:59:50.094115 21089 mvcc.cc:205] Tried to move back new op lower bound from 7316530749646221312 to 7316530749440761856. Current Snapshot: MvccSnapshot[applied={T|T < 7316530749646221312 or (T in {7316530749646221312})}]
I20260809 07:59:50.097002 20526 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 015cb67cf2304974a0aca388c8c02bdd: Sending DeleteTablet for 3 replicas of tablet 502b24997666453d84566edc7946b200
I20260809 07:59:50.098708 20833 tablet_service.cc:1514] Processing DeleteTablet for tablet 502b24997666453d84566edc7946b200 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:59:50 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:48290
I20260809 07:59:50.099192 20685 tablet_service.cc:1514] Processing DeleteTablet for tablet 502b24997666453d84566edc7946b200 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:59:50 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:49438
I20260809 07:59:50.099630 20959 tablet_service.cc:1514] Processing DeleteTablet for tablet 502b24997666453d84566edc7946b200 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 07:59:50 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:58562
I20260809 07:59:50.100665 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 20613
I20260809 07:59:50.109829 21098 tablet_replica.cc:330] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: stopping tablet replica
I20260809 07:59:50.116320 21096 tablet_replica.cc:330] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: stopping tablet replica
I20260809 07:59:50.116823 21098 raft_consensus.cc:2229] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 1 LEADER]: Raft consensus shutting down.
I20260809 07:59:50.117197 21096 raft_consensus.cc:2229] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 07:59:50.118014 21098 raft_consensus.cc:2258] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:59:50.118185 21096 raft_consensus.cc:2258] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 07:59:50.120007 21096 ts_tablet_manager.cc:1905] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:59:50.121328 21098 ts_tablet_manager.cc:1905] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 07:59:50.126324 21098 ts_tablet_manager.cc:1918] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:59:50.129065 21096 ts_tablet_manager.cc:1918] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 07:59:50.132197 21096 log.cc:1196] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/502b24997666453d84566edc7946b200
I20260809 07:59:50.132398 21098 log.cc:1196] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/502b24997666453d84566edc7946b200
I20260809 07:59:50.132877 21096 ts_tablet_manager.cc:1939] T 502b24997666453d84566edc7946b200 P fc07e4c3c05f4bdca57b99174e8cb7ae: Deleting consensus metadata
I20260809 07:59:50.133306 21098 ts_tablet_manager.cc:1939] T 502b24997666453d84566edc7946b200 P 12ade8ce70f44bf586775cff264bf504: Deleting consensus metadata
I20260809 07:59:50.135058 20512 catalog_manager.cc:4841] TS fc07e4c3c05f4bdca57b99174e8cb7ae (127.8.51.66:36137): tablet 502b24997666453d84566edc7946b200 (table test-table [id=46aa28709cf04656b2aa5fca9d5d4da5]) successfully deleted
I20260809 07:59:50.136577 20512 catalog_manager.cc:4841] TS 12ade8ce70f44bf586775cff264bf504 (127.8.51.67:41233): tablet 502b24997666453d84566edc7946b200 (table test-table [id=46aa28709cf04656b2aa5fca9d5d4da5]) successfully deleted
W20260809 07:59:50.137089 20512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:41041 (error 108)
I20260809 07:59:50.138123 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 20764
I20260809 07:59:50.148615 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 07:59:50.148229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41041 (local address 127.0.0.1:49446)
0809 07:59:50.148439 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 07:59:50.148516 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260809 07:59:50.149020 20512 catalog_manager.cc:4584] TS ba4097ebbbfa4b2ab796332ed4392347 (127.8.51.65:41041): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 502b24997666453d84566edc7946b200: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41041: connect: Connection refused (error 111)
I20260809 07:59:50.150053 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 20910
I20260809 07:59:50.160532 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 20493
I20260809 07:59:50.170469 8397 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 07:59:50.526166 8397 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 07:59:50.526340 8397 mini_ranger.cc:66] Stopping Ranger...
I20260809 07:59:50.872898 8397 mini_ranger.cc:68] Stopped Ranger
2026-08-09 07:59:50.873 UTC [20040] LOG: received smart shutdown request
2026-08-09 07:59:50.876 UTC [20040] LOG: background worker "logical replication launcher" (PID 20052) exited with exit code 1
2026-08-09 07:59:50.877 UTC [20045] LOG: shutting down
2026-08-09 07:59:51.030 UTC [20040] LOG: database system is shut down
2026-08-09T07:59:51Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46649 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 07:59:51 dist-test-slave-njxd krb5kdc[21109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 07:59:51 dist-test-slave-njxd krb5kdc[21109](info): set up 2 sockets
Aug 09 07:59:51 dist-test-slave-njxd krb5kdc[21109](info): commencing operation
krb5kdc: starting...
W20260809 07:59:52.199529 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 07:59:52 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T07:59:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T07:59:52Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangeradmin_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangeradmin_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangerlookup_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangerlookup_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
I20260809 07:59:52.362082 8397 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzQyOdB/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/postgres -l logfile start
2026-08-09 07:59:54.673 UTC [21141] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 07:59:54.673 UTC [21141] LOG: listening on IPv4 address "127.8.51.84", port 32947
2026-08-09 07:59:54.676 UTC [21141] LOG: listening on Unix socket "/tmp/.s.PGSQL.32947"
2026-08-09 07:59:54.696 UTC [21145] LOG: database system was shut down at 2026-08-09 07:59:53 UTC
2026-08-09 07:59:54.700 UTC [21141] LOG: database system is ready to accept connections
I20260809 07:59:55.671144 8397 mini_postgres.cc:96] Postgres bound to 32947
2026-08-09 07:59:55.678 UTC [21153] FATAL: database "slave" does not exist
127.8.51.84:32947 - accepting connections
I20260809 07:59:55.678838 8397 mini_ranger.cc:161] Starting Ranger...
I20260809 07:59:55.693802 8397 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 07:59:56.114979 8397 mini_ranger.cc:87] Created ranger Postgres database
I20260809 07:59:56.115056 8397 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin
2026-08-09 07:59:56,380 [I] DB FLAVOR :POSTGRES
2026-08-09 07:59:56,380 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 07:59:56,380 [I] Checking connection..
2026-08-09 07:59:56,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 07:59:56,645 [I] Checking connection passed.
2026-08-09 07:59:56,646 [I] --------- Verifying version history table ---------
2026-08-09 07:59:56,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:56,903 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 07:59:56,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:57,130 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 07:59:57,130 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 07:59:57,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 07:59:57.372 UTC [21225] WARNING: there is no transaction in progress
2026-08-09 07:59:57,379 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 07:59:57,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 07:59:57,641 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 07:59:57,641 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 07:59:57,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 07:59:57,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 07:59:58,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-09 07:59:58,382 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 07:59:58,646 [I] Table x_portal_user does not exist in database ranger
2026-08-09 07:59:58,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 07:59:58,902 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 07:59:58,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 07:59:59,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 07:59:59,389 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 07:59:59,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 08:00:00.297 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.313 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.328 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.344 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.358 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.376 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.426 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.432 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.445 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.454 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.464 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.477 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.485 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.491 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.498 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:00.504 UTC [21341] WARNING: there is no transaction in progress
2026-08-09 08:00:01,092 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 08:00:01,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 08:00:01,327 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 08:00:01,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 08:00:01,586 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 08:00:01,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 08:00:01,842 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 08:00:01,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 08:00:02,077 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 08:00:02,328 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-09 08:00:02,576 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 08:00:02,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 08:00:02,816 [I] DB_PATCHES have already been applied
I20260809 08:00:02.822489 8397 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzQyOdB/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 08:00:02.822558 8397 mini_ranger.cc:193] Using host: 127.8.51.84
I20260809 08:00:02.826793 8397 mini_ranger.cc:227] Ranger admin URL: http://127.8.51.84:55285
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 8:00:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 08:00:03.980873 8397 mini_ranger.cc:160] Time spent starting Ranger: real 8.302s user 0.004s sys 0.006s
Aug 09, 2026 8:00:23 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 8:00:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 8:00:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 8:00:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 8:00:24 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 08:00:25.358322 8397 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.51.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.51.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangerkms_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.51.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/rangerkms_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.51.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.51.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.51.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/HTTP_127.8.51.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 08:00:25 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262425, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 08:00:25.448035 8397 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 08:00:25.458189 8397 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 08:00:26.248663 8397 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 08:00:26.248744 8397 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms
I20260809 08:00:26.248756 8397 mini_ranger_kms.cc:227] Using postgres at 127.8.51.84:32947
2026-08-09 08:00:26,440 [I] DB FLAVOR :POSTGRES
2026-08-09 08:00:26,441 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 08:00:26,441 [I] Checking connection
2026-08-09 08:00:26,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 08:00:26,704 [I] connection success
2026-08-09 08:00:26,705 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 08:00:26,705 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 08:00:26,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 08:00:26,941 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 08:00:26,941 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 08:00:26,942 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 08:00:26,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.51.84:32947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 08:00:27,199 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 08:00:27.659673 8397 mini_ranger_kms.cc:310] Created kms service
I20260809 08:00:27.872258 8397 mini_ranger_kms.cc:326] Created kudu user
I20260809 08:00:27.915419 8397 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 08:00:27 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262425, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:28.306156 8397 mini_ranger_kms.cc:384] Added ranger policy
I20260809 08:00:28.306309 8397 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzQyOdB/build/debug/bin/postgresql.jar:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzQyOdB/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 08:00:28.306332 8397 mini_ranger_kms.cc:240] Using host: 127.8.51.84
I20260809 08:00:28.311353 8397 mini_ranger_kms.cc:276] Ranger KMS PID: 21533
I20260809 08:00:28.311439 8397 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.51.84:58073
Aug 09, 2026 8:00:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:00:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:00:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 8:00:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 8:00:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 8:00:30 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 08:00:30.623768 8397 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.176s user 0.002s sys 0.173s
I20260809 08:00:30.623910 8397 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 08:00:30.623996 8397 mini_ranger_kms.cc:401] 127.8.51.84:58073/kms/v1/keys
Aug 09 08:00:30 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786262430, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 08:00:31 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262430, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
Aug 09 08:00:31 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262430, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.51.84@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
Aug 09 08:00:33 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:00:33.927129 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38307
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38307
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:34.043788 21586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:34.044045 21586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:34.044083 21586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:34.048174 21586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:34.048233 21586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:34.048252 21586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:34.048269 21586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:34.048283 21586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:34.053877 21586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.51.84:58073/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38307
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:34.054999 21586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:34.056067 21586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:34.064945 21591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:34.064993 21592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:34.064966 21586 server_base.cc:1034] running on GCE node
W20260809 08:00:34.065249 21594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:34.065853 21586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:34.066932 21586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:34.068121 21586 hybrid_clock.cc:648] HybridClock initialized: now 1786262434068105 us; error 38 us; skew 500 ppm
Aug 09 08:00:34 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262434, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:34.074488 21586 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:34.075655 21586 webserver.cc:460] Webserver started at http://127.8.51.126:43075/ using document root <none> and password file <none>
I20260809 08:00:34.076390 21586 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:34.076478 21586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:34.076752 21586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 08:00:34 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262434, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:34.139532 21586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "cd5d223bf1bd48a790e932e006f6d610"
format_stamp: "Formatted at 2026-08-09 08:00:34 on dist-test-slave-njxd"
server_key: "84a798dbbee69ff2738c0c8345ba558b"
server_key_iv: "428315d667cfc520c642a659f63cbbd7"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:34.140213 21586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "cd5d223bf1bd48a790e932e006f6d610"
format_stamp: "Formatted at 2026-08-09 08:00:34 on dist-test-slave-njxd"
server_key: "84a798dbbee69ff2738c0c8345ba558b"
server_key_iv: "428315d667cfc520c642a659f63cbbd7"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:34.144436 21586 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:00:34.162708 21602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:34.164211 21586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 08:00:34.164362 21586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "cd5d223bf1bd48a790e932e006f6d610"
format_stamp: "Formatted at 2026-08-09 08:00:34 on dist-test-slave-njxd"
server_key: "84a798dbbee69ff2738c0c8345ba558b"
server_key_iv: "428315d667cfc520c642a659f63cbbd7"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:34.164505 21586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:34.173812 21586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:34.176656 21586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:34.176849 21586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:34.184927 21586 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38307
I20260809 08:00:34.184932 21658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38307 every 8 connection(s)
I20260809 08:00:34.185942 21586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:34.188748 21659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:34.194190 21659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Bootstrap starting.
I20260809 08:00:34.195475 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 21586
I20260809 08:00:34.195604 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:00:34.195928 8397 external_mini_cluster.cc:1428] Setting key ae8db2f194ccb5d859a626a96f907fa1
I20260809 08:00:34.196974 21659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:34.197965 21659 log.cc:824] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:34.200071 21659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: No bootstrap required, opened a new log
I20260809 08:00:34.203907 21659 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:34.204182 21659 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:34.204313 21659 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5d223bf1bd48a790e932e006f6d610, State: Initialized, Role: FOLLOWER
I20260809 08:00:34.204866 21659 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:34.205030 21659 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:34.205130 21659 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:34.205251 21659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:34.206337 21659 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
Aug 09 08:00:34 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:34.206740 21659 leader_election.cc:302] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd5d223bf1bd48a790e932e006f6d610; no voters:
I20260809 08:00:34.207108 21659 leader_election.cc:288] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:00:34.207588 21666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:34.207857 21666 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 LEADER]: Becoming Leader. State: Replica: cd5d223bf1bd48a790e932e006f6d610, State: Running, Role: LEADER
I20260809 08:00:34.208205 21666 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:34.208462 21659 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:34.211555 21659 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 08:00:34.211535 21665 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd5d223bf1bd48a790e932e006f6d610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } } }
I20260809 08:00:34.211649 21665 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:34.212163 21667 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd5d223bf1bd48a790e932e006f6d610. Latest consensus state: current_term: 1 leader_uuid: "cd5d223bf1bd48a790e932e006f6d610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } } }
I20260809 08:00:34.212294 21667 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:34.212877 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:34.197177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58584 (local address 127.8.51.126:38307)
0809 08:00:34.197712 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:34.197732 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:34.197778 (+ 46us) server_negotiation.cc:407] Connection header received
0809 08:00:34.198581 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:34.198600 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:34.198959 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:34.199322 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:34.200267 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:34.201761 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:34.203016 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:34.203803 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:34.203978 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:34.207167 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:34.207173 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:34.207208 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:34.207239 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:34.209214 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:34.209791 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:34.209798 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:34.209805 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:34.209945 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:34.210252 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:34.210256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:34.210257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:34.210780 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:34.210992 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:34.211581 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 08:00:34.211858 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":147,"threads_started":1}
I20260809 08:00:34.215698 21679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:34.221150 21679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:34.229358 21679 catalog_manager.cc:1347] Generated new cluster ID: ffd552bc329045e7900406180de0c9b3
I20260809 08:00:34.229427 21679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:34.252959 21679 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:00:34.254340 21679 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:34.270408 21679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Generated new TSK 0
I20260809 08:00:34.271344 21679 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:00:35.049044 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:35.227032 21708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:35.227463 21708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:35.227564 21708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:35.234257 21708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:35.234402 21708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:35.234553 21708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:00:35.242075 21708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:35.243345 21708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:35.244570 21708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:35.257385 21719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:35.257377 21717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:35.258867 21708 server_base.cc:1034] running on GCE node
W20260809 08:00:35.259444 21716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:35.260010 21708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:35.260773 21708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:35.261914 21708 hybrid_clock.cc:648] HybridClock initialized: now 1786262435261851 us; error 78 us; skew 500 ppm
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:35.265678 21708 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:00:35.266747 21708 webserver.cc:460] Webserver started at http://127.8.51.65:44923/ using document root <none> and password file <none>
I20260809 08:00:35.267453 21708 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:35.267529 21708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:35.267768 21708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:35.300258 21708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "38ac7fb2487e424dbbcafbb35fa9407d"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "a10895ba8e09ff96c88e19fec026ecc1"
server_key_iv: "31d92795220014f46b25ee4b9a367ec6"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.301288 21708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "38ac7fb2487e424dbbcafbb35fa9407d"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "a10895ba8e09ff96c88e19fec026ecc1"
server_key_iv: "31d92795220014f46b25ee4b9a367ec6"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.306943 21708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 08:00:35.327368 21728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.329136 21708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 08:00:35.329288 21708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "38ac7fb2487e424dbbcafbb35fa9407d"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "a10895ba8e09ff96c88e19fec026ecc1"
server_key_iv: "31d92795220014f46b25ee4b9a367ec6"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.329427 21708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:35.356563 21708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:35.360351 21708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:35.360608 21708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:35.361346 21708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:35.362454 21708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:35.362582 21708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.362710 21708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:35.362788 21708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.377161 21708 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:37175
I20260809 08:00:35.378403 21708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:00:35.379570 21846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:37175 every 8 connection(s)
I20260809 08:00:35.383713 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 21708
I20260809 08:00:35.383828 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:00:35.384212 8397 external_mini_cluster.cc:1428] Setting key 8b22bf90a423d5bce2a433d4ea0cc6eb
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:00:35.410909 21849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:35.381849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38827 (local address 127.8.51.126:38307)
0809 08:00:35.392317 (+ 10468us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:35.392322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:35.392338 (+ 16us) server_negotiation.cc:407] Connection header received
0809 08:00:35.392383 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:35.392386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:35.392440 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:35.392536 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:35.394282 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.395182 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.396930 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.397314 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.397430 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:35.405761 (+ 8331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:35.405766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:35.405769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:35.405805 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:35.407869 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:35.408713 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:35.408717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:35.408719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:35.408824 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:35.409291 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:35.409295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:35.409297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:35.409635 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:35.409754 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:35.410518 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 08:00:35.410709 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10377,"thread_start_us":70,"threads_started":1}
I20260809 08:00:35.412928 21850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:35.382421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.65:38827)
0809 08:00:35.390540 (+ 8119us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:35.390623 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:35.391813 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:35.392890 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:35.392900 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:35.393318 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:35.394097 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:35.394118 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.395339 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.395343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:35.396779 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:35.396791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.397644 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.397649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:35.397856 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:35.398773 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:35.398796 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:35.402046 (+ 3250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:35.408039 (+ 5993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:35.408048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:35.408085 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:35.408500 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:35.408948 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:35.408951 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:35.408953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:35.409172 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:35.409828 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:35.409836 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:35.410213 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 08:00:35.411410 (+ 1197us) client_negotiation.cc:240] Negotiation successful
0809 08:00:35.411816 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7798,"thread_start_us":165,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 08:00:35.417459 21847 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:35.417843 21847 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:35.418462 21847 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:35.420322 21621 ts_manager.cc:194] Registered new tserver with Master: 38ac7fb2487e424dbbcafbb35fa9407d (127.8.51.65:37175)
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:35.421876 21621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:38827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:00:35.464857 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:35.602669 21853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:35.603102 21853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:35.603256 21853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:35.608225 21853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:35.608318 21853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:35.608433 21853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:00:35.614549 21853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:35.615818 21853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:35.617030 21853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:35.627272 21862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:35.627611 21860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:35.627454 21859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:35.628204 21853 server_base.cc:1034] running on GCE node
I20260809 08:00:35.628682 21853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:35.629469 21853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:35.630666 21853 hybrid_clock.cc:648] HybridClock initialized: now 1786262435630628 us; error 53 us; skew 500 ppm
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:35.633764 21853 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:00:35.634956 21853 webserver.cc:460] Webserver started at http://127.8.51.66:44861/ using document root <none> and password file <none>
I20260809 08:00:35.635617 21853 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:35.635711 21853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:35.635977 21853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:35.668303 21853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "ce4a95508b6a48fa9feb76b6049e94d7"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "1929023b83bfa00b77a09173d5102222"
server_key_iv: "858867a75526523beb4d728348325957"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.669232 21853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "ce4a95508b6a48fa9feb76b6049e94d7"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "1929023b83bfa00b77a09173d5102222"
server_key_iv: "858867a75526523beb4d728348325957"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.683403 21853 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.000s sys 0.003s
I20260809 08:00:35.700289 21870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.701905 21853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:00:35.702080 21853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ce4a95508b6a48fa9feb76b6049e94d7"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "1929023b83bfa00b77a09173d5102222"
server_key_iv: "858867a75526523beb4d728348325957"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:35.702229 21853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:35.758122 21853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:35.762450 21853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:35.762671 21853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:35.763455 21853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:35.764555 21853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:35.764622 21853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.764693 21853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:35.764725 21853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:35.777545 21853 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:38971
I20260809 08:00:35.777607 21991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:38971 every 8 connection(s)
I20260809 08:00:35.778766 21853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:00:35.782861 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 21853
I20260809 08:00:35.782998 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:00:35.783349 8397 external_mini_cluster.cc:1428] Setting key 33032811a9958a215d8abb59ff3a0808
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:00:35.801136 21849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:35.780905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:40951 (local address 127.8.51.126:38307)
0809 08:00:35.782622 (+ 1717us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:35.782628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:35.782647 (+ 19us) server_negotiation.cc:407] Connection header received
0809 08:00:35.783870 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:35.783874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:35.783939 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:35.784006 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:35.785956 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.786796 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.789206 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.789645 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.789746 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:35.795026 (+ 5280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:35.795032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:35.795035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:35.795087 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:35.797674 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:35.798451 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:35.798455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:35.798457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:35.798558 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:35.798958 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:35.798962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:35.798964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:35.799177 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:35.799294 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:35.800844 (+ 1550us) server_negotiation.cc:299] Negotiation successful
0809 08:00:35.800989 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1602}
I20260809 08:00:35.801677 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:35.781480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.66:40951)
0809 08:00:35.782315 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:35.782373 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:35.783587 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:35.784617 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:35.784626 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:35.785010 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:35.785772 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:35.785797 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.786976 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.786982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:35.789037 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:35.789067 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:35.789983 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:35.789989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:35.790251 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:35.792736 (+ 2485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:35.792766 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:35.794769 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:35.797843 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:35.797853 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:35.797875 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:35.798318 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:35.798662 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:35.798666 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:35.798668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:35.798834 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:35.799294 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:35.799303 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:35.799714 (+ 411us) client_negotiation.cc:769] Sending connection context
0809 08:00:35.799955 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 08:00:35.800362 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":161,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 08:00:35.803107 21992 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:35.803375 21992 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:35.803954 21992 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:35.805153 21621 ts_manager.cc:194] Registered new tserver with Master: ce4a95508b6a48fa9feb76b6049e94d7 (127.8.51.66:38971)
I20260809 08:00:35.806048 21621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:40951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:00:35.825623 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 08:00:35 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262435, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
W20260809 08:00:35.985404 21997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:35.985848 21997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:35.985939 21997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:35.992156 21997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:35.992259 21997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:35.992349 21997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:00:36.000658 21997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:36.002226 21997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:36.003611 21997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:36.016817 22004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.016831 22006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.017819 22003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:36.018931 21997 server_base.cc:1034] running on GCE node
I20260809 08:00:36.019497 21997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:36.020354 21997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:36.027848 21997 hybrid_clock.cc:648] HybridClock initialized: now 1786262436027748 us; error 105 us; skew 500 ppm
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:36.032052 21997 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:00:36.033355 21997 webserver.cc:460] Webserver started at http://127.8.51.67:40919/ using document root <none> and password file <none>
I20260809 08:00:36.034196 21997 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:36.034312 21997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:36.034690 21997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:36.061908 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0"
format_stamp: "Formatted at 2026-08-09 08:00:36 on dist-test-slave-njxd"
server_key: "431c1862823f7d27c57a76c027689df9"
server_key_iv: "b416397207730e63b22830bd6892759a"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.064325 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0"
format_stamp: "Formatted at 2026-08-09 08:00:36 on dist-test-slave-njxd"
server_key: "431c1862823f7d27c57a76c027689df9"
server_key_iv: "b416397207730e63b22830bd6892759a"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.070302 21997 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 08:00:36.088992 22014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.090909 21997 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260809 08:00:36.091061 21997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0"
format_stamp: "Formatted at 2026-08-09 08:00:36 on dist-test-slave-njxd"
server_key: "431c1862823f7d27c57a76c027689df9"
server_key_iv: "b416397207730e63b22830bd6892759a"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.091213 21997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:36.111977 21997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:36.116209 21997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:36.116499 21997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:36.117297 21997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:36.118520 21997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:36.118647 21997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.118759 21997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:36.118826 21997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.130515 21997 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36745
I20260809 08:00:36.131929 21997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:00:36.133236 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 21997
I20260809 08:00:36.133368 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:00:36.133785 8397 external_mini_cluster.cc:1428] Setting key 69363248a815570def505cea0d42b7d3
I20260809 08:00:36.137127 22133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36745 every 8 connection(s)
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:36.155946 21849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:36.141250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:55575 (local address 127.8.51.126:38307)
0809 08:00:36.141405 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:36.141409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:36.141824 (+ 415us) server_negotiation.cc:407] Connection header received
0809 08:00:36.143147 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:36.143151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:36.143211 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:36.143274 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:36.145047 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.145862 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.147670 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.148034 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.148117 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:36.151396 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:36.151401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:36.151404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:36.151433 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:36.153265 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:36.153959 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:36.153962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:36.153964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:36.154069 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:36.154569 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:36.154573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:36.154575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:36.154808 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:36.154891 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:36.155623 (+ 732us) server_negotiation.cc:299] Negotiation successful
0809 08:00:36.155769 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:00:36.157729 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:36.140031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.67:55575)
0809 08:00:36.141655 (+ 1624us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:36.141716 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:36.142873 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:36.143731 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:36.143741 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:36.144134 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:36.144858 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:36.144881 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.146021 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.146025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:36.147498 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:36.147511 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.148336 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.148340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:36.148560 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:36.149322 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:36.149344 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:36.151177 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:36.153402 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:36.153409 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:36.153428 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:36.153838 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:36.154176 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:36.154180 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:36.154182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:36.154441 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:36.154960 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:36.154968 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:36.155337 (+ 369us) client_negotiation.cc:769] Sending connection context
0809 08:00:36.156128 (+ 791us) client_negotiation.cc:240] Negotiation successful
0809 08:00:36.156509 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1342,"thread_start_us":181,"threads_started":1}
I20260809 08:00:36.159386 22134 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:36.159677 22134 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:36.160290 22134 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:36.161705 21621 ts_manager.cc:194] Registered new tserver with Master: 60e5ce2178dc4e8f82a4fe4afd11c3d0 (127.8.51.67:36745)
I20260809 08:00:36.162439 21621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:55575
I20260809 08:00:36.173552 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:00:36.174548 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 21708
I20260809 08:00:36.193210 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 21853
I20260809 08:00:36.202545 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 21997
I20260809 08:00:36.212420 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 21586
I20260809 08:00:36.221082 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38307
--webserver_interface=127.8.51.126
--webserver_port=43075
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38307
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:36.336349 22138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:36.336645 22138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:36.336731 22138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:36.340891 22138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:36.341055 22138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:36.341115 22138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:36.341143 22138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:36.341189 22138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:36.346832 22138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38307
--ranger_config_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=43075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:36.348040 22138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:36.349159 22138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:36.358098 22143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.358090 22148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.358090 22145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:36.358582 22138 server_base.cc:1034] running on GCE node
I20260809 08:00:36.359167 22138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:36.360304 22138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:36.361471 22138 hybrid_clock.cc:648] HybridClock initialized: now 1786262436361451 us; error 30 us; skew 500 ppm
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:36.364346 22138 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:36.365360 22138 webserver.cc:460] Webserver started at http://127.8.51.126:43075/ using document root <none> and password file <none>
I20260809 08:00:36.365990 22138 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:36.366088 22138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:36.419437 22138 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:00:36.422452 22156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.424118 22138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:00:36.424250 22138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "cd5d223bf1bd48a790e932e006f6d610"
format_stamp: "Formatted at 2026-08-09 08:00:34 on dist-test-slave-njxd"
server_key: "84a798dbbee69ff2738c0c8345ba558b"
server_key_iv: "428315d667cfc520c642a659f63cbbd7"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.424829 22138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:36.443621 22138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:36.446610 22138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:36.446849 22138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:36.454552 22138 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38307
I20260809 08:00:36.454569 22214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38307 every 8 connection(s)
I20260809 08:00:36.455741 22138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:36.459885 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22138
I20260809 08:00:36.460355 22215 sys_catalog.cc:263] Verifying existing consensus state
I20260809 08:00:36.460363 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:37175
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:38307
--webserver_port=44923
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:36.462363 22215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Bootstrap starting.
I20260809 08:00:36.486203 22215 log.cc:824] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:36.495026 22215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:00:36.495535 22215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Bootstrap complete.
I20260809 08:00:36.501114 22215 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:36.501719 22215 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5d223bf1bd48a790e932e006f6d610, State: Initialized, Role: FOLLOWER
I20260809 08:00:36.502287 22215 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:36.502451 22215 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:36.502529 22215 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:36.502632 22215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 1 FOLLOWER]: Advancing to term 2
I20260809 08:00:36.504869 22215 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:36.505237 22215 leader_election.cc:302] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd5d223bf1bd48a790e932e006f6d610; no voters:
I20260809 08:00:36.505648 22215 leader_election.cc:288] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 08:00:36.505741 22219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 08:00:36.505959 22219 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [term 2 LEADER]: Becoming Leader. State: Replica: cd5d223bf1bd48a790e932e006f6d610, State: Running, Role: LEADER
I20260809 08:00:36.506424 22219 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } }
I20260809 08:00:36.506994 22215 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:36.507444 22219 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd5d223bf1bd48a790e932e006f6d610. Latest consensus state: current_term: 2 leader_uuid: "cd5d223bf1bd48a790e932e006f6d610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } } }
I20260809 08:00:36.508275 22219 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:36.508139 22220 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cd5d223bf1bd48a790e932e006f6d610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5d223bf1bd48a790e932e006f6d610" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38307 } } }
I20260809 08:00:36.509024 22220 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:36.509158 22229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:36.511027 22215 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 08:00:36.515096 22229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:36.516387 22229 catalog_manager.cc:1259] Loaded cluster ID: ffd552bc329045e7900406180de0c9b3
I20260809 08:00:36.516494 22229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:36.519560 22229 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:36.520423 22229 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Loaded TSK: 0
I20260809 08:00:36.521843 22229 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 08:00:36.630736 22217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:36.631139 22217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:36.631213 22217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:36.637985 22217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:36.638144 22217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:36.638269 22217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:00:36.647022 22217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:37175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=44923
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:36.648761 22217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:36.650266 22217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:36.664067 22257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.664108 22255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.664108 22254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:36.665364 22217 server_base.cc:1034] running on GCE node
I20260809 08:00:36.665948 22217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:36.666848 22217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:36.668838 22217 hybrid_clock.cc:648] HybridClock initialized: now 1786262436668807 us; error 47 us; skew 500 ppm
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:36.672995 22217 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:00:36.674242 22217 webserver.cc:460] Webserver started at http://127.8.51.65:44923/ using document root <none> and password file <none>
I20260809 08:00:36.675016 22217 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:36.675208 22217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:36.695603 22217 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:00:36.699415 22266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.700947 22217 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:00:36.701112 22217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "38ac7fb2487e424dbbcafbb35fa9407d"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "a10895ba8e09ff96c88e19fec026ecc1"
server_key_iv: "31d92795220014f46b25ee4b9a367ec6"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.701783 22217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:36.723496 22217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:36.727566 22217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:36.727813 22217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:36.728938 22217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:36.730259 22217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:36.730351 22217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.730412 22217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:36.730491 22217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 08:00:36.749194 22217 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:37175
I20260809 08:00:36.752759 22217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:00:36.755788 22391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:37175 every 8 connection(s)
I20260809 08:00:36.760993 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22217
I20260809 08:00:36.761545 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:38971
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:38307
--webserver_port=44861
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:36.778868 22395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:36.759679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:56835 (local address 127.8.51.126:38307)
0809 08:00:36.760137 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:36.760160 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:36.760213 (+ 53us) server_negotiation.cc:407] Connection header received
0809 08:00:36.761004 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:36.761019 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:36.761448 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:36.761862 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:36.763704 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.765257 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.767205 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.768028 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.768212 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:36.771855 (+ 3643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:36.771864 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:36.771885 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:36.771926 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:36.774265 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:36.775084 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:36.775091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:36.775099 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:36.775270 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:36.775757 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:36.775761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:36.775762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:36.776316 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:36.776433 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:36.777302 (+ 869us) server_negotiation.cc:299] Negotiation successful
0809 08:00:36.777697 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260809 08:00:36.780830 22394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:36.758456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.65:56835)
0809 08:00:36.759129 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:36.759202 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:36.760340 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:36.762380 (+ 2040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:36.762389 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:36.762778 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:36.763468 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:36.763492 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.765448 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.765452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:36.767040 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:36.767055 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:36.768476 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:36.768481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:36.768704 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:36.769616 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:36.769656 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:36.771545 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:36.774453 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:36.774460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:36.774477 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:36.774918 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:36.775411 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:36.775414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:36.775416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:36.775613 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:36.776537 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:36.776544 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:36.776903 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 08:00:36.779402 (+ 2499us) client_negotiation.cc:240] Negotiation successful
0809 08:00:36.779790 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":196,"threads_started":1}
I20260809 08:00:36.784113 22392 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:36.784421 22392 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:36.784976 22392 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:36.787334 22392 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38307 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 08:00:36.787492 22392 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:36.787734 22392 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:36.788695 22392 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:36.788956 22392 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:36.790234 22392 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 08:00:36.920670 22396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:36.921011 22396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:36.921099 22396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:36.926182 22396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:36.926292 22396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:36.926405 22396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:00:36.933866 22396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:38971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=44861
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:36.935309 22396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:36.936553 22396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:36.951529 22405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:36.951522 22402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:36.951841 22396 server_base.cc:1034] running on GCE node
W20260809 08:00:36.951952 22403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:36.952451 22396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:36.953233 22396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:36.954414 22396 hybrid_clock.cc:648] HybridClock initialized: now 1786262436954384 us; error 47 us; skew 500 ppm
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:36.957815 22396 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:00:36.959015 22396 webserver.cc:460] Webserver started at http://127.8.51.66:44861/ using document root <none> and password file <none>
I20260809 08:00:36.959825 22396 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:36.959970 22396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 08:00:36 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:36.978817 22396 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:00:36.982120 22414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:36.983826 22396 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 08:00:36.983959 22396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ce4a95508b6a48fa9feb76b6049e94d7"
format_stamp: "Formatted at 2026-08-09 08:00:35 on dist-test-slave-njxd"
server_key: "1929023b83bfa00b77a09173d5102222"
server_key_iv: "858867a75526523beb4d728348325957"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:36.984685 22396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:37.002298 22396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:37.005846 22396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:37.006167 22396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:37.007102 22396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:37.008364 22396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:37.008440 22396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:37.008539 22396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:37.008589 22396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:37.020131 22396 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:38971
I20260809 08:00:37.020284 22534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:38971 every 8 connection(s)
I20260809 08:00:37.021667 22396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:00:37.024271 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22396
I20260809 08:00:37.024775 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.51.84:58073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:36745
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:38307
--webserver_port=40919
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 08:00:37 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262436, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:37.045979 22395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:37.028986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:59337 (local address 127.8.51.126:38307)
0809 08:00:37.029148 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:37.029153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:37.031463 (+ 2310us) server_negotiation.cc:407] Connection header received
0809 08:00:37.032371 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:37.032375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:37.032437 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:37.032526 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:37.034200 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.035081 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.037009 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.037468 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.037562 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:37.041178 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:37.041197 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:37.041202 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:37.041240 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:37.043228 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.043913 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.043919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.043922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.044020 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.044464 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.044468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.044470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.044699 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:37.044790 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:37.045634 (+ 844us) server_negotiation.cc:299] Negotiation successful
0809 08:00:37.045781 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:00:37.047027 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:37.029704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.66:59337)
0809 08:00:37.031302 (+ 1598us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:37.031343 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:37.032159 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:37.032860 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:37.032871 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:37.033260 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:37.034006 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:37.034031 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.035261 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.035267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:37.036846 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:37.036861 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.037822 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.037829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:37.038073 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:37.038872 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:37.038901 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:37.040941 (+ 2040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:37.043362 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:37.043368 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:37.043387 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:37.043777 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:37.044145 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:37.044148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:37.044150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:37.044341 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:37.044862 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:37.044869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:37.045286 (+ 417us) client_negotiation.cc:769] Sending connection context
0809 08:00:37.045500 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 08:00:37.045908 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1412,"thread_start_us":147,"threads_started":1}
I20260809 08:00:37.048388 22535 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:37.048658 22535 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.049260 22535 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:37.050961 22535 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38307 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 08:00:37.051096 22535 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.051268 22535 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:37.052129 22535 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.052282 22535 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:37.053015 22535 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 08:00:37.170986 22538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:37.171279 22538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:37.171377 22538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:37.175685 22538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:37.175761 22538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:37.175882 22538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:00:37.181699 22538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.51.84:58073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:36745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=40919
--tserver_master_addrs=127.8.51.126:38307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:37.183141 22538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:37.184497 22538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:37.195382 22544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:37.195454 22545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:37.195385 22547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:37.196198 22538 server_base.cc:1034] running on GCE node
I20260809 08:00:37.196619 22538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:37.197263 22538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:37.198437 22538 hybrid_clock.cc:648] HybridClock initialized: now 1786262437198419 us; error 34 us; skew 500 ppm
Aug 09 08:00:37 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:37.202045 22538 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:00:37.203136 22538 webserver.cc:460] Webserver started at http://127.8.51.67:40919/ using document root <none> and password file <none>
I20260809 08:00:37.203850 22538 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:37.203964 22538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 08:00:37 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:37.224928 22538 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:00:37.227782 22556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:37.229477 22538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 08:00:37.229662 22538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0"
format_stamp: "Formatted at 2026-08-09 08:00:36 on dist-test-slave-njxd"
server_key: "431c1862823f7d27c57a76c027689df9"
server_key_iv: "b416397207730e63b22830bd6892759a"
server_key_version: "kuduclusterkey@0"
I20260809 08:00:37.230564 22538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:37.266979 22538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:37.270961 22538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:37.271250 22538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:37.272051 22538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:37.273299 22538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:37.273459 22538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:37.273607 22538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:37.273705 22538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:37.285723 22538 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36745
I20260809 08:00:37.287017 22538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:00:37.287942 22674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36745 every 8 connection(s)
I20260809 08:00:37.290271 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22538
Aug 09 08:00:37 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:37.304390 22395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:37.289073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:47667 (local address 127.8.51.126:38307)
0809 08:00:37.289217 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:37.289221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:37.290458 (+ 1237us) server_negotiation.cc:407] Connection header received
0809 08:00:37.291781 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:37.291784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:37.291832 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:37.291911 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:37.293361 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.294181 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.295882 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.296237 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.296364 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:37.299881 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:37.299885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:37.299887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:37.299936 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:37.301398 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.302044 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.302048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.302049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.302621 (+ 572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.303053 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.303057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.303058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.303295 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:37.303384 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:37.304083 (+ 699us) server_negotiation.cc:299] Negotiation successful
0809 08:00:37.304213 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 08:00:37.305413 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:37.289680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38307 (local address 127.8.51.67:47667)
0809 08:00:37.290274 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:37.290335 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:37.291556 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:37.292088 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:37.292099 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:37.292490 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:37.293173 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:37.293200 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.294351 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.294354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:37.295734 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:37.295745 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.296399 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.296402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:37.296539 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:37.297403 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:37.297426 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:37.299693 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:37.301517 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:37.301524 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:37.301541 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:37.301908 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:37.302733 (+ 825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:37.302736 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:37.302738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:37.302931 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:37.303456 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:37.303465 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:37.303813 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 08:00:37.304027 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 08:00:37.304356 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":142,"threads_started":1}
I20260809 08:00:37.306723 22675 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38307
I20260809 08:00:37.306979 22675 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.307039 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:37.290961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58590 (local address 127.8.51.126:38307)
0809 08:00:37.291216 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:37.291221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:37.291517 (+ 296us) server_negotiation.cc:407] Connection header received
0809 08:00:37.291647 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:37.291651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:37.291709 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:37.291814 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:37.293000 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.293907 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.296467 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:37.296819 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:37.296942 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:37.298556 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:37.298559 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:37.298561 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:37.298582 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:37.300356 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.300886 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.300892 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.300895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.302616 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:37.304569 (+ 1953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:37.304572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:37.304574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:37.304778 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:37.304967 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:37.306703 (+ 1736us) server_negotiation.cc:299] Negotiation successful
0809 08:00:37.306878 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":102,"threads_started":1}
I20260809 08:00:37.307602 22675 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:37.309211 22675 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38307 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 08:00:37.309376 22675 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.309544 22675 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:37.310416 22675 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.310612 22675 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
W20260809 08:00:37.312172 22675 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 08:00:37 dist-test-slave-njxd krb5kdc[21109](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:37.790460 22392 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:37.790794 22392 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:37.791945 22173 ts_manager.cc:194] Registered new tserver with Master: 38ac7fb2487e424dbbcafbb35fa9407d (127.8.51.65:37175)
I20260809 08:00:37.793448 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:56835
Aug 09 08:00:38 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:38.053247 22535 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:38.053555 22535 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:38.054267 22173 ts_manager.cc:194] Registered new tserver with Master: ce4a95508b6a48fa9feb76b6049e94d7 (127.8.51.66:38971)
I20260809 08:00:38.055042 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:59337
Aug 09 08:00:38 dist-test-slave-njxd krb5kdc[21109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262437, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for HTTP/127.8.51.84@KRBTEST.COM
I20260809 08:00:38.312412 22675 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:38.312718 22675 heartbeater.cc:511] Master 127.8.51.126:38307 requested a full tablet report, sending...
I20260809 08:00:38.313529 22173 ts_manager.cc:194] Registered new tserver with Master: 60e5ce2178dc4e8f82a4fe4afd11c3d0 (127.8.51.67:36745)
I20260809 08:00:38.314345 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:47667
I20260809 08:00:38.318331 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:00:38.348081 22702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.321694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.8.51.126:38307)
0809 08:00:38.322739 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.322744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.330075 (+ 7331us) server_negotiation.cc:407] Connection header received
0809 08:00:38.330125 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.330128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.330179 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.330285 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:38.331241 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.332052 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.333226 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.333585 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.333707 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.343864 (+ 10157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:38.343869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:38.343875 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:38.343914 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:38.345954 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:38.346545 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:38.346548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:38.346550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:38.346645 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:38.346943 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:38.346946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:38.346948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:38.347170 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:38.347272 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.347701 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.347838 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":102,"threads_started":1}
I20260809 08:00:38.352986 22173 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:00:38.358038 22173 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:00:38.389456 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.378462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38971 (local address 127.0.0.1:34292)
0809 08:00:38.379982 (+ 1520us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.379993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.380054 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.380870 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:38.380876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:38.380897 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:38.381035 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.381041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.382453 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.382457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.384526 (+ 2069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.384537 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.388874 (+ 4337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.388878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.388985 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.389023 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 08:00:38.389127 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 08:00:38.389252 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1472,"thread_start_us":100,"threads_started":1}
I20260809 08:00:38.392820 22713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.379094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.8.51.66:38971)
0809 08:00:38.380276 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.380283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.380303 (+ 20us) server_negotiation.cc:407] Connection header received
0809 08:00:38.380373 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.380378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.380568 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.380714 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:38.381163 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.382322 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.386960 (+ 4638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.388537 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.388642 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.388810 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.392547 (+ 3737us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.392655 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1083,"thread_start_us":89,"threads_started":1}
I20260809 08:00:38.395586 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.377612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36745 (local address 127.0.0.1:59094)
0809 08:00:38.378619 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.378672 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.378807 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.385276 (+ 6469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:38.385280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:38.385297 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:38.385380 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.385385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.390116 (+ 4731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.390120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.391397 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.391408 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.395222 (+ 3814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.395226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.395318 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.395344 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 08:00:38.395389 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 08:00:38.395452 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":74,"threads_started":1}
I20260809 08:00:38.396440 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.377985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.8.51.67:36745)
0809 08:00:38.384809 (+ 6824us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.384816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.384839 (+ 23us) server_negotiation.cc:407] Connection header received
0809 08:00:38.384908 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.384913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.385117 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.385531 (+ 414us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:38.385733 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.386827 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.391549 (+ 4722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.392409 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.396029 (+ 3620us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.396172 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.396221 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.396307 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6716,"thread_start_us":69,"threads_started":1}
I20260809 08:00:38.397061 22464 tablet_service.cc:1467] Processing CreateTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c (DEFAULT_TABLE table=test-table [id=1e7b8c7d9d75476ab20e191d6ffb68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:38.398283 22464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cedf72b96b9e4ee78d39b8eb79734d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:38.400327 22593 tablet_service.cc:1467] Processing CreateTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c (DEFAULT_TABLE table=test-table [id=1e7b8c7d9d75476ab20e191d6ffb68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:38.401396 22593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cedf72b96b9e4ee78d39b8eb79734d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:38.402665 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.376673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:37175 (local address 127.0.0.1:46606)
0809 08:00:38.379725 (+ 3052us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.379738 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.379821 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.396716 (+ 16895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:38.396720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:38.396738 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:38.396826 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.396831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.399238 (+ 2407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.399242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.400397 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.400408 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.402308 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.402312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.402396 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.402421 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 08:00:38.402470 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 08:00:38.402532 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1194,"thread_start_us":106,"threads_started":1}
I20260809 08:00:38.403483 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.377501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46606 (local address 127.8.51.65:37175)
0809 08:00:38.394746 (+ 17245us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.394753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.394777 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:00:38.394852 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.394858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.395050 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.396972 (+ 1922us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:38.397119 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.399102 (+ 1983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.401353 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.402170 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.403080 (+ 910us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.403222 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.403270 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.403348 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17124,"thread_start_us":125,"threads_started":1}
I20260809 08:00:38.405879 22320 tablet_service.cc:1467] Processing CreateTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c (DEFAULT_TABLE table=test-table [id=1e7b8c7d9d75476ab20e191d6ffb68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:38.406740 22320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cedf72b96b9e4ee78d39b8eb79734d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:38.421151 22714 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Bootstrap starting.
I20260809 08:00:38.422088 22715 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Bootstrap starting.
I20260809 08:00:38.424389 22714 tablet_bootstrap.cc:654] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:38.424389 22715 tablet_bootstrap.cc:654] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:38.425273 22714 log.cc:824] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:38.425791 22716 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Bootstrap starting.
I20260809 08:00:38.425289 22715 log.cc:824] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:38.428630 22716 tablet_bootstrap.cc:654] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:38.429745 22716 log.cc:824] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:38.435035 22714 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: No bootstrap required, opened a new log
I20260809 08:00:38.435261 22714 ts_tablet_manager.cc:1397] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260809 08:00:38.435858 22715 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: No bootstrap required, opened a new log
I20260809 08:00:38.436149 22715 ts_tablet_manager.cc:1397] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260809 08:00:38.439538 22714 raft_consensus.cc:348] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.439842 22714 raft_consensus.cc:374] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:38.439904 22714 raft_consensus.cc:729] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4a95508b6a48fa9feb76b6049e94d7, State: Initialized, Role: FOLLOWER
I20260809 08:00:38.440537 22715 raft_consensus.cc:348] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.444427 22715 raft_consensus.cc:374] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:38.444543 22715 raft_consensus.cc:729] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ac7fb2487e424dbbcafbb35fa9407d, State: Initialized, Role: FOLLOWER
I20260809 08:00:38.445261 22715 consensus_queue.cc:260] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.446731 22715 ts_tablet_manager.cc:1428] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260809 08:00:38.447172 22392 heartbeater.cc:503] Master 127.8.51.126:38307 was elected leader, sending a full tablet report...
I20260809 08:00:38.449216 22714 consensus_queue.cc:260] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.450425 22714 ts_tablet_manager.cc:1428] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260809 08:00:38.453650 22535 heartbeater.cc:503] Master 127.8.51.126:38307 was elected leader, sending a full tablet report...
I20260809 08:00:38.456308 22716 tablet_bootstrap.cc:492] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: No bootstrap required, opened a new log
I20260809 08:00:38.456586 22716 ts_tablet_manager.cc:1397] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.000s
I20260809 08:00:38.460842 22716 raft_consensus.cc:348] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.461223 22716 raft_consensus.cc:374] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:38.461318 22716 raft_consensus.cc:729] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e5ce2178dc4e8f82a4fe4afd11c3d0, State: Initialized, Role: FOLLOWER
I20260809 08:00:38.461946 22716 consensus_queue.cc:260] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.463111 22716 ts_tablet_manager.cc:1428] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:00:38.463507 22675 heartbeater.cc:503] Master 127.8.51.126:38307 was elected leader, sending a full tablet report...
I20260809 08:00:38.470311 22721 raft_consensus.cc:482] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:38.470479 22721 raft_consensus.cc:504] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.477275 22721 leader_election.cc:288] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e5ce2178dc4e8f82a4fe4afd11c3d0 (127.8.51.67:36745), 38ac7fb2487e424dbbcafbb35fa9407d (127.8.51.65:37175)
I20260809 08:00:38.494094 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.474885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:44391 (local address 127.8.51.67:36745)
0809 08:00:38.475022 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.475027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.477661 (+ 2634us) server_negotiation.cc:407] Connection header received
0809 08:00:38.481196 (+ 3535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.481200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.481258 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.481321 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:38.481944 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.482703 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.492753 (+ 10050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.493314 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.493401 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.493471 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.493867 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.493955 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 08:00:38.494585 22724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.474475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36745 (local address 127.8.51.66:44391)
0809 08:00:38.477533 (+ 3058us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.477549 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.477744 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.481462 (+ 3718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:38.481464 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:38.481482 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:38.481812 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.481823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.482849 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.482851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.484112 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.484122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.493569 (+ 9447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.493603 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.493720 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.493743 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 08:00:38.494316 (+ 573us) client_negotiation.cc:240] Negotiation successful
0809 08:00:38.494399 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2992,"thread_start_us":150,"threads_started":1}
I20260809 08:00:38.495230 22626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cedf72b96b9e4ee78d39b8eb79734d5c" candidate_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" is_pre_election: true
I20260809 08:00:38.495572 22626 raft_consensus.cc:2454] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4a95508b6a48fa9feb76b6049e94d7 in term 0.
I20260809 08:00:38.496134 22416 leader_election.cc:302] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e5ce2178dc4e8f82a4fe4afd11c3d0, ce4a95508b6a48fa9feb76b6049e94d7; no voters:
I20260809 08:00:38.496464 22721 raft_consensus.cc:2781] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:00:38.496547 22721 raft_consensus.cc:482] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:00:38.496591 22721 raft_consensus.cc:3037] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:38.498044 22721 raft_consensus.cc:504] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.498677 22626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cedf72b96b9e4ee78d39b8eb79734d5c" candidate_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0"
I20260809 08:00:38.498809 22626 raft_consensus.cc:3037] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:38.500003 22626 raft_consensus.cc:2454] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4a95508b6a48fa9feb76b6049e94d7 in term 1.
I20260809 08:00:38.500314 22416 leader_election.cc:302] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e5ce2178dc4e8f82a4fe4afd11c3d0, ce4a95508b6a48fa9feb76b6049e94d7; no voters:
I20260809 08:00:38.500706 22721 leader_election.cc:288] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [CANDIDATE]: Term 1 election: Requested vote from peers 60e5ce2178dc4e8f82a4fe4afd11c3d0 (127.8.51.67:36745), 38ac7fb2487e424dbbcafbb35fa9407d (127.8.51.65:37175)
I20260809 08:00:38.500801 22721 raft_consensus.cc:2781] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:38.500867 22721 raft_consensus.cc:686] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 1 LEADER]: Becoming Leader. State: Replica: ce4a95508b6a48fa9feb76b6049e94d7, State: Running, Role: LEADER
I20260809 08:00:38.501201 22721 consensus_queue.cc:237] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } }
I20260809 08:00:38.504379 22175 catalog_manager.cc:5495] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce4a95508b6a48fa9feb76b6049e94d7 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38971 } health_report { overall_health: HEALTHY } } }
W20260809 08:00:38.506740 22393 tablet.cc:2369] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:38.508539 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.475578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:49075 (local address 127.8.51.65:37175)
0809 08:00:38.475720 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.475725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.485570 (+ 9845us) server_negotiation.cc:407] Connection header received
0809 08:00:38.489805 (+ 4235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.489809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.489867 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.489915 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:38.490345 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.491177 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.505668 (+ 14491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.506320 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.506428 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.506492 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.508293 (+ 1801us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.508408 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 08:00:38.509024 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.475226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:37175 (local address 127.8.51.66:49075)
0809 08:00:38.485467 (+ 10241us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.485482 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.489613 (+ 4131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.490071 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:38.490074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:38.490091 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:38.490205 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.490211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.491399 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.491401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.492579 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:38.492590 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.508009 (+ 15419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.508013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:38.508133 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.508163 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 08:00:38.508787 (+ 624us) client_negotiation.cc:240] Negotiation successful
0809 08:00:38.508876 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10169,"thread_start_us":112,"threads_started":1}
I20260809 08:00:38.509711 22339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cedf72b96b9e4ee78d39b8eb79734d5c" candidate_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" is_pre_election: true
I20260809 08:00:38.510042 22339 raft_consensus.cc:2454] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4a95508b6a48fa9feb76b6049e94d7 in term 0.
I20260809 08:00:38.510403 22340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cedf72b96b9e4ee78d39b8eb79734d5c" candidate_uuid: "ce4a95508b6a48fa9feb76b6049e94d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ac7fb2487e424dbbcafbb35fa9407d"
I20260809 08:00:38.510514 22340 raft_consensus.cc:3037] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:38.511874 22340 raft_consensus.cc:2454] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4a95508b6a48fa9feb76b6049e94d7 in term 1.
W20260809 08:00:38.532258 22536 tablet.cc:2369] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:38.537088 22713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.531098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34298 (local address 127.8.51.66:38971)
0809 08:00:38.531247 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:38.531252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:38.531272 (+ 20us) server_negotiation.cc:407] Connection header received
0809 08:00:38.531367 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:38.531370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:38.531446 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:38.531568 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:00:38.532877 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.533645 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.534928 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:38.535271 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:38.535371 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:38.535794 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:00:38.536350 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:00:38.536464 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:38.536863 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 08:00:38.536926 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 08:00:38.538792 22677 tablet.cc:2369] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:38.544883 22340 raft_consensus.cc:1261] T cedf72b96b9e4ee78d39b8eb79734d5c P 38ac7fb2487e424dbbcafbb35fa9407d [term 1 FOLLOWER]: Refusing update from remote peer ce4a95508b6a48fa9feb76b6049e94d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:38.545734 22725 consensus_queue.cc:1035] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ac7fb2487e424dbbcafbb35fa9407d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:38.552734 22626 raft_consensus.cc:1261] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 1 FOLLOWER]: Refusing update from remote peer ce4a95508b6a48fa9feb76b6049e94d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:38.553464 22725 consensus_queue.cc:1035] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e5ce2178dc4e8f82a4fe4afd11c3d0" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:38.560784 22729 mvcc.cc:205] Tried to move back new op lower bound from 7316530948270956544 to 7316530948104077312. Current Snapshot: MvccSnapshot[applied={T|T < 7316530948270956544}]
I20260809 08:00:38.563812 22730 mvcc.cc:205] Tried to move back new op lower bound from 7316530948270956544 to 7316530948104077312. Current Snapshot: MvccSnapshot[applied={T|T < 7316530948270956544}]
I20260809 08:00:38.573422 22173 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:38.573668 22173 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:38.576532 22173 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd5d223bf1bd48a790e932e006f6d610: Sending DeleteTablet for 3 replicas of tablet cedf72b96b9e4ee78d39b8eb79734d5c
I20260809 08:00:38.577827 22320 tablet_service.cc:1514] Processing DeleteTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:38 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:46606
I20260809 08:00:38.578370 22464 tablet_service.cc:1514] Processing DeleteTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:38 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:34292
I20260809 08:00:38.579229 22593 tablet_service.cc:1514] Processing DeleteTablet for tablet cedf72b96b9e4ee78d39b8eb79734d5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:38 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:59094
I20260809 08:00:38.580448 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22217
I20260809 08:00:38.591701 22738 tablet_replica.cc:330] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7: stopping tablet replica
I20260809 08:00:38.592077 22738 raft_consensus.cc:2229] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:00:38.592440 22738 raft_consensus.cc:2258] T cedf72b96b9e4ee78d39b8eb79734d5c P ce4a95508b6a48fa9feb76b6049e94d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:38.592820 22739 tablet_replica.cc:330] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: stopping tablet replica
I20260809 08:00:38.593118 22739 raft_consensus.cc:2229] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:38.593390 22739 raft_consensus.cc:2258] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 08:00:38.602110 22161 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:37175 (error 108)
I20260809 08:00:38.603343 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22396
I20260809 08:00:38.606928 22739 ts_tablet_manager.cc:1905] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:38.609918 22739 ts_tablet_manager.cc:1918] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:38.610044 22739 log.cc:1196] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/cedf72b96b9e4ee78d39b8eb79734d5c
I20260809 08:00:38.610373 22739 ts_tablet_manager.cc:1939] T cedf72b96b9e4ee78d39b8eb79734d5c P 60e5ce2178dc4e8f82a4fe4afd11c3d0: Deleting consensus metadata
I20260809 08:00:38.611613 22158 catalog_manager.cc:4841] TS 60e5ce2178dc4e8f82a4fe4afd11c3d0 (127.8.51.67:36745): tablet cedf72b96b9e4ee78d39b8eb79734d5c (table test-table [id=1e7b8c7d9d75476ab20e191d6ffb68fb]) successfully deleted
I20260809 08:00:38.613554 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:38.613178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:37175 (local address 127.0.0.1:46610)
0809 08:00:38.613382 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.613463 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260809 08:00:38.614347 22161 catalog_manager.cc:4584] TS 38ac7fb2487e424dbbcafbb35fa9407d (127.8.51.65:37175): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cedf72b96b9e4ee78d39b8eb79734d5c: Network error: Client connection negotiation failed: client connection to 127.8.51.65:37175: connect: Connection refused (error 111)
W20260809 08:00:38.622402 22710 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:00:38.621740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38971 (local address 127.0.0.1:34314)
0809 08:00:38.621926 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:38.621943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:38.622043 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:38.622284 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.66:38971: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 08:00:38.623064 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22538
I20260809 08:00:38.640897 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22138
I20260809 08:00:38.651304 8397 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 08:00:38.996207 8397 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 08:00:38.996332 8397 mini_ranger.cc:66] Stopping Ranger...
I20260809 08:00:39.341459 8397 mini_ranger.cc:68] Stopped Ranger
2026-08-09 08:00:39.341 UTC [21141] LOG: received smart shutdown request
2026-08-09 08:00:39.346 UTC [21141] LOG: background worker "logical replication launcher" (PID 21151) exited with exit code 1
2026-08-09 08:00:39.346 UTC [21146] LOG: shutting down
2026-08-09 08:00:39.506 UTC [21141] LOG: database system is shut down
2026-08-09T08:00:39Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48480 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:00:39 dist-test-slave-njxd krb5kdc[22760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:00:39 dist-test-slave-njxd krb5kdc[22760](info): set up 2 sockets
Aug 09 08:00:39 dist-test-slave-njxd krb5kdc[22760](info): commencing operation
krb5kdc: starting...
W20260809 08:00:40.676283 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:00:40 dist-test-slave-njxd krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:00:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:00:40.801020 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42211
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:40.911381 22774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:40.911680 22774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:40.911759 22774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:40.915692 22774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:40.915787 22774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:40.915823 22774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:40.915876 22774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:40.915925 22774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:40.921046 22774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:42211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:40.922175 22774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:40.923221 22774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:40.931573 22783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:40.931591 22781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:40.931596 22780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:40.932392 22774 server_base.cc:1034] running on GCE node
I20260809 08:00:40.932890 22774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:40.933976 22774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:40.935165 22774 hybrid_clock.cc:648] HybridClock initialized: now 1786262440935139 us; error 37 us; skew 500 ppm
Aug 09 08:00:40 dist-test-slave-njxd krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:40.938035 22774 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:40.938818 22774 webserver.cc:460] Webserver started at http://127.8.51.126:41883/ using document root <none> and password file <none>
I20260809 08:00:40.939322 22774 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:40.939376 22774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:40.939538 22774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:40.941331 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "2e6c3b85db584927bb5b5642f2836d74"
format_stamp: "Formatted at 2026-08-09 08:00:40 on dist-test-slave-njxd"
server_key: "cd0189727ec0cd2fbcb70b66ad2ce24e"
server_key_iv: "68610cd235d453f2a312235ad11b9206"
server_key_version: "encryptionkey@0"
I20260809 08:00:40.941876 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "2e6c3b85db584927bb5b5642f2836d74"
format_stamp: "Formatted at 2026-08-09 08:00:40 on dist-test-slave-njxd"
server_key: "cd0189727ec0cd2fbcb70b66ad2ce24e"
server_key_iv: "68610cd235d453f2a312235ad11b9206"
server_key_version: "encryptionkey@0"
I20260809 08:00:40.945895 22774 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 08:00:40.948221 22790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:40.949404 22774 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:40.949501 22774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "2e6c3b85db584927bb5b5642f2836d74"
format_stamp: "Formatted at 2026-08-09 08:00:40 on dist-test-slave-njxd"
server_key: "cd0189727ec0cd2fbcb70b66ad2ce24e"
server_key_iv: "68610cd235d453f2a312235ad11b9206"
server_key_version: "encryptionkey@0"
I20260809 08:00:40.949687 22774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:40.970412 22774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:40.973017 22774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:40.973163 22774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:40.980144 22774 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:42211
I20260809 08:00:40.980156 22844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:42211 every 8 connection(s)
I20260809 08:00:40.981102 22774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:40.983867 22845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:40.987429 22845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:00:40.988134 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22774
I20260809 08:00:40.988265 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:00:40.988546 8397 external_mini_cluster.cc:1428] Setting key e72ba35854eae705969d214c8706c864
WARNING: no policy specified for kudu/127.8.51.125@KRBTEST.COM; defaulting to no policy
Aug 09 08:00:40 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.125@KRBTEST.COM" created.
I20260809 08:00:41.002707 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:40.989833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42211 (local address 127.0.0.1:34736)
0809 08:00:40.990291 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:40.990341 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:40.991148 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:40.991826 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:40.991831 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:40.992284 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:40.992521 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:40.992533 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:40.993847 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:40.993851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:40.994581 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:40.994591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:40.995235 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:40.995239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:40.995411 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:40.996104 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:40.996119 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:40.997751 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:40.999833 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:40.999839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:40.999847 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.000105 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.000445 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.000451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.000455 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.000612 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.001177 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.001187 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.001367 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.001594 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.001926 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":38,"spinlock_wait_cycles":5504,"thread_start_us":125,"threads_started":1}
I20260809 08:00:41.002714 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:40.989833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34736 (local address 127.8.51.126:42211)
0809 08:00:40.990368 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:40.990382 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:40.990438 (+ 56us) server_negotiation.cc:407] Connection header received
0809 08:00:40.991455 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:40.991460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:40.991640 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:40.991826 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:40.992684 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:40.993724 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:40.994706 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:40.995075 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:40.995339 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:40.997899 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:40.997905 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:40.997915 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:40.997937 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:40.999685 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.000232 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.000238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.000239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.000342 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.000718 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.000720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.000721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.001059 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.001158 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.001694 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.002022 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":199,"server-negotiator.queue_time_us":408,"thread_start_us":159,"threads_started":1}
I20260809 08:00:41.005158 22845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:00:41.005964 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.005715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33236)
0809 08:00:41.005825 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.005911 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 08:00:41.006155 22794 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
I20260809 08:00:41.006963 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.006754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33250)
0809 08:00:41.006864 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.006914 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 08:00:41.007120 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:44409: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
I20260809 08:00:41.016575 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:44409
--webserver_interface=127.8.51.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:41.056385 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } attempt: 1
I20260809 08:00:41.057240 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.056938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33252)
0809 08:00:41.057090 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.057161 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 08:00:41.057984 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.057768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33266)
0809 08:00:41.057876 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.057927 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 08:00:41.058120 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:44409: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
I20260809 08:00:41.126276 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } attempt: 2
I20260809 08:00:41.127076 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.126788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33272)
0809 08:00:41.126933 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.127000 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 08:00:41.127949 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.127600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33278)
0809 08:00:41.127772 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.127855 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260809 08:00:41.128202 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:44409: Network error: Client connection negotiation failed: client connection to 127.8.51.125:44409: connect: Connection refused (error 111)
W20260809 08:00:41.130681 22854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:41.130934 22854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:41.131039 22854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:41.135124 22854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:41.135183 22854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:41.135203 22854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:41.135372 22854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:41.135425 22854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:41.141242 22854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:44409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.51.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:41.142426 22854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:41.143501 22854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:41.152145 22862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:41.152119 22860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:41.152119 22859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:41.152531 22854 server_base.cc:1034] running on GCE node
I20260809 08:00:41.153095 22854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:41.154356 22854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:41.155519 22854 hybrid_clock.cc:648] HybridClock initialized: now 1786262441155485 us; error 48 us; skew 500 ppm
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:41.158483 22854 init.cc:377] Logged in from keytab as kudu/127.8.51.125@KRBTEST.COM (short username kudu)
I20260809 08:00:41.159354 22854 webserver.cc:460] Webserver started at http://127.8.51.125:42027/ using document root <none> and password file <none>
I20260809 08:00:41.159909 22854 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:41.159968 22854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:41.160209 22854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:41.162384 22854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data/instance:
uuid: "fad2fef5ecab4f149f1b2ddab8f24bec"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "4f365b61f3741dbd8fa6176d404d06a5"
server_key_iv: "e48011bde6083291bf15b9caf04710ca"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.162966 22854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal/instance:
uuid: "fad2fef5ecab4f149f1b2ddab8f24bec"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "4f365b61f3741dbd8fa6176d404d06a5"
server_key_iv: "e48011bde6083291bf15b9caf04710ca"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.166495 22854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:00:41.168776 22869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:41.170011 22854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:41.170146 22854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "fad2fef5ecab4f149f1b2ddab8f24bec"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "4f365b61f3741dbd8fa6176d404d06a5"
server_key_iv: "e48011bde6083291bf15b9caf04710ca"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.170264 22854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:41.190508 22854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:41.193337 22854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:41.193533 22854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:41.200222 22854 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.125:44409
I20260809 08:00:41.200327 22924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.125:44409 every 8 connection(s)
I20260809 08:00:41.201136 22854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
I20260809 08:00:41.202826 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22854
I20260809 08:00:41.202965 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-1/wal/instance
I20260809 08:00:41.203275 8397 external_mini_cluster.cc:1428] Setting key 651c714bd95e3797a58c3d476a672c8f
I20260809 08:00:41.204000 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:41.209288 22925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.51.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.124@KRBTEST.COM" created.
I20260809 08:00:41.219414 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } attempt: 3
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:00:41.226449 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.211226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34746 (local address 127.8.51.126:42211)
0809 08:00:41.211389 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.211394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.212267 (+ 873us) server_negotiation.cc:407] Connection header received
0809 08:00:41.213158 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.213161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.213211 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.213334 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.214653 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.215447 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.217235 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.217670 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.217794 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.220354 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.220358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.220360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.220385 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.224062 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.224705 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.224711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.224713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.224789 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.225237 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.225241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.225243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.225436 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.225638 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.226127 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.226256 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 08:00:41.227427 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.211606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42211 (local address 127.0.0.1:34746)
0809 08:00:41.212078 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.212131 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.212960 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.213534 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.213541 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.213934 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.214477 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.214492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.215596 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.215601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.217086 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.217101 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.217816 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.217819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.217966 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.218570 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.218587 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.220164 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.224182 (+ 4018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.224191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.224210 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.224582 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.224884 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.224886 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.224887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.225120 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.225566 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.225612 (+ 46us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.225869 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.226057 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.226372 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":133,"threads_started":1}
I20260809 08:00:41.229293 22925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
I20260809 08:00:41.230635 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.219908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33290)
0809 08:00:41.220117 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.220133 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.220207 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.220878 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.220881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.221055 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.221153 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.221158 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.222608 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.222613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.223126 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.223134 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.224008 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.224011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.224092 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.224622 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.224660 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.226647 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.228899 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.228902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.228905 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.229143 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.229522 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.229525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.229527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.229643 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.230189 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.230192 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.230286 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.230369 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.230497 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 08:00:41.231127 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:40803
--webserver_interface=127.8.51.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:41.231396 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.220048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.8.51.125:44409)
0809 08:00:41.220443 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.220457 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.220481 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:00:41.220522 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.220530 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.220745 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.220896 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.221269 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.222491 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.223250 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.223878 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.223998 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.226793 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.226802 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.226815 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.226838 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.228799 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.229287 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.229292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.229294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.229380 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.229742 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.229746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.229748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.230060 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.230957 (+ 897us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.231053 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.231163 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":126,"threads_started":1}
I20260809 08:00:41.233724 22845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:00:41.234568 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.234224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50474)
0809 08:00:41.234405 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.234467 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:00:41.235378 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.235092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50482)
0809 08:00:41.235275 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.235331 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260809 08:00:41.235558 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
I20260809 08:00:41.239187 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.229913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33302 (local address 127.8.51.125:44409)
0809 08:00:41.230217 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.230226 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.230237 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:00:41.230268 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.230270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.230309 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.230397 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.230900 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.231667 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.232615 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.233016 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.233125 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.235314 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.235321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.235327 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.235358 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.237319 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.237787 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.237794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.237798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.237896 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.238251 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.238253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.238254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.238416 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.238493 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.238823 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.239034 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":88,"server-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
I20260809 08:00:41.239187 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.229864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:33302)
0809 08:00:41.230024 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.230040 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.230112 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.230435 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.230440 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.230654 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.230765 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.230774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.231779 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.231783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.232447 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.232456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.233144 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.233148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.233245 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.233792 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.233805 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.235170 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.237429 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.237432 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.237433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.237691 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.238039 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.238044 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.238049 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.238144 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.238518 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.238523 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.238639 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.238776 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.238943 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 08:00:41.239912 22925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:00:41.240564 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.240353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50488)
0809 08:00:41.240457 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.240519 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 08:00:41.240823 22870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
I20260809 08:00:41.241747 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.241478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50504)
0809 08:00:41.241570 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.241705 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 08:00:41.241966 22925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
I20260809 08:00:41.266752 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 1
I20260809 08:00:41.267590 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.267297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50508)
0809 08:00:41.267446 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.267514 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 08:00:41.268399 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.268190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50524)
0809 08:00:41.268299 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.268345 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 08:00:41.268566 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
I20260809 08:00:41.291280 22925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 1
I20260809 08:00:41.292155 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.291857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50540)
0809 08:00:41.292010 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.292072 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 08:00:41.292882 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.292690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50550)
0809 08:00:41.292789 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.292832 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 08:00:41.293051 22925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
I20260809 08:00:41.343866 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 2
W20260809 08:00:41.344383 22932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:41.344774 22932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:41.344877 22932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 08:00:41.344864 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.344481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50564)
0809 08:00:41.344656 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.344719 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 08:00:41.345626 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.345379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50572)
0809 08:00:41.345481 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.345526 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 08:00:41.345759 22845 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
W20260809 08:00:41.349220 22932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:41.349314 22932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:41.349359 22932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:41.349393 22932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:41.349426 22932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:41.355002 22932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:42211,127.8.51.125:44409,127.8.51.124:40803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:40803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.51.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:41.356051 22932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:41.357054 22932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:00:41.361227 22925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 2
I20260809 08:00:41.362000 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.361695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50578)
0809 08:00:41.361857 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.361920 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 08:00:41.362705 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.362444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:50590)
0809 08:00:41.362558 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.362624 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 08:00:41.362848 22925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:40803: Network error: Client connection negotiation failed: client connection to 127.8.51.124:40803: connect: Connection refused (error 111)
W20260809 08:00:41.365703 22940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:41.365700 22939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:41.366015 22932 server_base.cc:1034] running on GCE node
W20260809 08:00:41.365739 22942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:41.366587 22932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:41.367533 22932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:41.368718 22932 hybrid_clock.cc:648] HybridClock initialized: now 1786262441368711 us; error 34 us; skew 500 ppm
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:41.371475 22932 init.cc:377] Logged in from keytab as kudu/127.8.51.124@KRBTEST.COM (short username kudu)
I20260809 08:00:41.372320 22932 webserver.cc:460] Webserver started at http://127.8.51.124:44341/ using document root <none> and password file <none>
I20260809 08:00:41.372884 22932 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:41.372972 22932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:41.373179 22932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:41.375252 22932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data/instance:
uuid: "602e229d4dd84fc2981d4fb28013ed3e"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "fcd70d8c86994ebf0ba4b5ef946d9a82"
server_key_iv: "00a9246a0372be2e034f3dddf321eb13"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.375801 22932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal/instance:
uuid: "602e229d4dd84fc2981d4fb28013ed3e"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "fcd70d8c86994ebf0ba4b5ef946d9a82"
server_key_iv: "00a9246a0372be2e034f3dddf321eb13"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.379349 22932 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 08:00:41.381687 22949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:41.382891 22932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:00:41.383036 22932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "602e229d4dd84fc2981d4fb28013ed3e"
format_stamp: "Formatted at 2026-08-09 08:00:41 on dist-test-slave-njxd"
server_key: "fcd70d8c86994ebf0ba4b5ef946d9a82"
server_key_iv: "00a9246a0372be2e034f3dddf321eb13"
server_key_version: "encryptionkey@0"
I20260809 08:00:41.383140 22932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:41.394248 22932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:41.396790 22932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:41.396993 22932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:41.403820 22932 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.124:40803
I20260809 08:00:41.403836 23008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.124:40803 every 8 connection(s)
I20260809 08:00:41.404675 22932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
I20260809 08:00:41.407377 23009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:41.408524 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 22932
I20260809 08:00:41.408666 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786262281998942-8397-0/minicluster-data/master-2/wal/instance
I20260809 08:00:41.408972 8397 external_mini_cluster.cc:1428] Setting key d6fd27a6acb36495218e9fc5be47b0a8
I20260809 08:00:41.411522 23009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:41.422672 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.413377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53938 (local address 127.8.51.126:42211)
0809 08:00:41.413513 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.413518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.413836 (+ 318us) server_negotiation.cc:407] Connection header received
0809 08:00:41.414030 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.414033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.414076 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.414164 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.414838 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.415333 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.416245 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.416474 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.416587 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.419289 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.419293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.419295 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.419327 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.420729 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.421290 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.421297 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.421301 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.421406 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.421669 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.421671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.421672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.421848 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.421923 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.422385 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.422515 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:00:41.423606 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.410288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.8.51.124:40803)
0809 08:00:41.410651 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.410666 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.410705 (+ 39us) server_negotiation.cc:407] Connection header received
0809 08:00:41.411294 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.411311 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.411608 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.411937 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.412741 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.414138 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.415004 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.415487 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.415664 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.418442 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.418449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.418463 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.418490 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.420327 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.420841 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.420847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.420849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.421057 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.421367 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.421370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.421371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.421861 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.422051 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.422269 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.422553 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":234,"spinlock_wait_cycles":3456,"thread_start_us":120,"threads_started":1}
I20260809 08:00:41.423606 23013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.413313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:42211 (local address 127.0.0.1:53938)
0809 08:00:41.413720 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.413758 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.413889 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.414220 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.414226 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.414590 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.414710 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.414716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.415458 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.415461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.416097 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.416106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.416626 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.416631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.416749 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.417307 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.417331 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.419147 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.420834 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.420840 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.420850 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.421181 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.421490 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.421493 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.421494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.421571 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.421948 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.421955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.422081 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.422269 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.422604 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":99,"spinlock_wait_cycles":1280,"thread_start_us":112,"threads_started":1}
I20260809 08:00:41.424896 23009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:41.433660 23013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.425399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:44409 (local address 127.0.0.1:45364)
0809 08:00:41.425550 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.425567 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.425698 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.425972 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.425975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.426151 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.426283 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.426289 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.427047 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.427053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.427573 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.427580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.428061 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.428064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.428160 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.428650 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.428663 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.430228 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.432149 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.432154 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.432159 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.432432 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.432705 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.432710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.432715 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.432807 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.433164 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.433171 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.433275 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.433358 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.433456 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 08:00:41.433934 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.425490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.8.51.125:44409)
0809 08:00:41.425664 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.425668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.425684 (+ 16us) server_negotiation.cc:407] Connection header received
0809 08:00:41.425797 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.425801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.425852 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.425942 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.426407 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.426939 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.427696 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.427946 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.428063 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.430389 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.430393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.430395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.430426 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.432027 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.432534 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.432536 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.432538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.432611 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.432902 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.432904 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.432905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.433062 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.433135 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.433450 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.433610 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:00:41.434698 23009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:00:41.434870 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.426180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.8.51.126:42211)
0809 08:00:41.426287 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.426293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.426310 (+ 17us) server_negotiation.cc:407] Connection header received
0809 08:00:41.426442 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.426445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.426490 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.426572 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.427162 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.427630 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.428400 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.428624 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.428730 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.431481 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.431485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.431487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.431511 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.433097 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.433549 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.433552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.433554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.433674 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.433995 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.433999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.434001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.434217 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.434462 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.434584 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.434699 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:00:41.442821 23013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.435218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:52064)
0809 08:00:41.435339 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.435355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.435427 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.435739 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.435742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.435900 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.435987 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.435994 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.437053 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.437056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.437549 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.437556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.438053 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.438057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.438148 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.438599 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.438612 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.439739 (+ 1127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.441397 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.441403 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.441406 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.441644 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.441895 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.441898 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.441900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.441979 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.442320 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.442322 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.442401 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.442511 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.442650 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 08:00:41.442867 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.435421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52064 (local address 127.8.51.124:40803)
0809 08:00:41.435534 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.435541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.435555 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:00:41.435590 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.435592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.435633 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.435729 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.436100 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.436936 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.437719 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.437948 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.438021 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.439861 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.439865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.439867 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.439896 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.441294 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.441722 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.441727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.441729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.441801 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.442063 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.442068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.442069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.442228 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.442330 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.442563 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.442713 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":46}
I20260809 08:00:41.444779 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.436115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45370 (local address 127.8.51.125:44409)
0809 08:00:41.436240 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.436244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.436257 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:00:41.436355 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.436358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.436393 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.436483 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.437055 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.437522 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.438514 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.438741 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.438852 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.441455 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.441459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.441462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.441492 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.443193 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.443627 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.443632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.443634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.443735 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.444022 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.444025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.444026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.444191 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.444348 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.444548 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.444642 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:00:41.444918 22845 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 3
I20260809 08:00:41.446691 23009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: Bootstrap starting.
I20260809 08:00:41.448212 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:00:41.449750 23009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:41.450680 23009 log.cc:824] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:41.453066 23009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: No bootstrap required, opened a new log
I20260809 08:00:41.453997 22925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } attempt: 3
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262440, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:00:41.457823 23009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.458245 23009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:41.458300 23009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 602e229d4dd84fc2981d4fb28013ed3e, State: Initialized, Role: FOLLOWER
I20260809 08:00:41.458981 23009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.460341 23009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:41.460738 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.450831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.8.51.126:42211)
0809 08:00:41.450935 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.450939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.451443 (+ 504us) server_negotiation.cc:407] Connection header received
0809 08:00:41.451588 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.451591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.451642 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.451728 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.452514 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.453232 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.454411 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.454748 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.454819 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.456520 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.456524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.456526 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.456550 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.458592 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.459066 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.459069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.459071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.459158 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.459510 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.459515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.459518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.459763 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.459892 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.460462 (+ 570us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.460571 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 08:00:41 dist-test-slave-njxd krb5kdc[22760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262441, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:00:41.464784 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.445382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:52078)
0809 08:00:41.445622 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.445646 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.445734 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.449947 (+ 4213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.449950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.450128 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.450217 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.450223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.451517 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.451520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.452300 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.452313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.452846 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.452850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.452984 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.453602 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.453619 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.455092 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.462967 (+ 7875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.462973 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.462975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.463340 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.463732 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.463736 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.463739 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.463842 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.464295 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.464298 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.464397 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.464480 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.464617 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 08:00:41.466058 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.445410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52078 (local address 127.8.51.124:40803)
0809 08:00:41.449733 (+ 4323us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.449737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.449752 (+ 15us) server_negotiation.cc:407] Connection header received
0809 08:00:41.449793 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.449796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.449847 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.449926 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.450374 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.451432 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.452431 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.452733 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.452846 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.455496 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.455504 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.455510 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.455537 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.462581 (+ 7044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.463499 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.463502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.463504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.463606 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.463965 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.463967 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.463969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.464172 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.465735 (+ 1563us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.465804 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.465910 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4212}
I20260809 08:00:41.466248 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.454370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:40803 (local address 127.0.0.1:52092)
0809 08:00:41.454632 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:41.454646 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:41.454720 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:41.455606 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:41.455609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:41.455812 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:41.455951 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.455960 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.457137 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.457141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.458133 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:41.458146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.458794 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.458798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:41.458911 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.459970 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:41.459983 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:41.461523 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:41.464565 (+ 3042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.464570 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.464575 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.464816 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.465152 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:41.465156 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:41.465160 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:41.465263 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:41.465784 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:41.465787 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:41.465876 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 08:00:41.465957 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 08:00:41.466070 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260809 08:00:41.467131 23023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.454856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52092 (local address 127.8.51.124:40803)
0809 08:00:41.455356 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.455367 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.455380 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:00:41.455414 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.455419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.455463 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.456070 (+ 607us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.456206 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.456948 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.458284 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.458616 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.459181 (+ 565us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.461738 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.461742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.461744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.461767 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.464455 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.464950 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.464954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.464958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.465046 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.465378 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.465382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.465385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.465669 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.466525 (+ 856us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.466602 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.466936 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":94,"threads_started":1}
I20260809 08:00:41.467849 23024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.467993 23024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.470232 23020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.450571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52084 (local address 127.8.51.124:40803)
0809 08:00:41.451193 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.451201 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.461270 (+ 10069us) server_negotiation.cc:407] Connection header received
0809 08:00:41.461457 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.461460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.461498 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.461565 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.462470 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.463271 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.464242 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.464568 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.464643 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.466290 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.466294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.466296 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.466323 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.468229 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.468744 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.468749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.468752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.468840 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.469206 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.469211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.469214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.469419 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.469545 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.469917 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.470029 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":79,"threads_started":1}
W20260809 08:00:41.470477 23035 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:00:41.470544 23035 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:00:41.471424 22925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: Bootstrap starting.
I20260809 08:00:41.471880 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:41.450961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.8.51.125:44409)
0809 08:00:41.451063 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:41.451067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:41.461848 (+ 10781us) server_negotiation.cc:407] Connection header received
0809 08:00:41.462018 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:41.462023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:41.462076 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:41.462130 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:41.463005 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.463668 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.464654 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:41.464966 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:41.465041 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:41.468153 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:41.468157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:41.468160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:41.468186 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:41.469776 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.470214 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.470217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.470219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.470304 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:41.470909 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:41.470912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:41.470913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:41.471102 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:41.471194 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:41.471604 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 08:00:41.471712 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 08:00:41.473755 22925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:41.474977 22925 log.cc:824] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:41.475966 22845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: Bootstrap starting.
I20260809 08:00:41.474835 22932 master_runner.cc:186] Error getting master registration for 127.8.51.126:42211: OK, instance_id { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" instance_seqno: 1786262440978200 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:00:41.477455 22932 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:00:41.478053 22845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:41.478873 22845 log.cc:824] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:41.479084 22925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: No bootstrap required, opened a new log
I20260809 08:00:41.480823 22845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: No bootstrap required, opened a new log
I20260809 08:00:41.482686 22925 raft_consensus.cc:348] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.482887 22925 raft_consensus.cc:374] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:41.482962 22925 raft_consensus.cc:729] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fad2fef5ecab4f149f1b2ddab8f24bec, State: Initialized, Role: FOLLOWER
I20260809 08:00:41.483417 22925 consensus_queue.cc:260] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.483855 23039 sys_catalog.cc:455] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.484020 23039 sys_catalog.cc:458] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.484637 22925 sys_catalog.cc:564] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:41.484709 22845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.484925 22845 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:41.484980 22845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e6c3b85db584927bb5b5642f2836d74, State: Initialized, Role: FOLLOWER
I20260809 08:00:41.485378 22845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.486785 22845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 08:00:41.490398 23052 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:00:41.490514 23052 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:00:41.488646 22854 master_runner.cc:186] Error getting master registration for 127.8.51.126:42211: OK, instance_id { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" instance_seqno: 1786262440978200 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:00:41.491753 22854 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:00:41.489831 23040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.492225 23040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 08:00:41.492805 23063 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:00:41.492880 23063 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:00:41.497262 22774 master_runner.cc:263] No leader master found from master 2e6c3b85db584927bb5b5642f2836d74
I20260809 08:00:41.497341 22774 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 08:00:41.648373 22955 tablet.cc:2369] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 08:00:41.699892 22875 tablet.cc:2369] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 08:00:41.724902 22796 tablet.cc:2369] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:41.753134 23040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:41.753332 23040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.754356 23040 leader_election.cc:288] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fad2fef5ecab4f149f1b2ddab8f24bec (127.8.51.125:44409), 602e229d4dd84fc2981d4fb28013ed3e (127.8.51.124:40803)
I20260809 08:00:41.754920 22898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e6c3b85db584927bb5b5642f2836d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" is_pre_election: true
I20260809 08:00:41.754920 22980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e6c3b85db584927bb5b5642f2836d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "602e229d4dd84fc2981d4fb28013ed3e" is_pre_election: true
I20260809 08:00:41.755210 22898 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e6c3b85db584927bb5b5642f2836d74 in term 0.
I20260809 08:00:41.755225 22980 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e6c3b85db584927bb5b5642f2836d74 in term 0.
I20260809 08:00:41.755667 22791 leader_election.cc:302] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e6c3b85db584927bb5b5642f2836d74, 602e229d4dd84fc2981d4fb28013ed3e; no voters:
I20260809 08:00:41.755934 23040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:00:41.756031 23040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:00:41.756089 23040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:41.757143 23040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.757457 23040 leader_election.cc:288] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [CANDIDATE]: Term 1 election: Requested vote from peers fad2fef5ecab4f149f1b2ddab8f24bec (127.8.51.125:44409), 602e229d4dd84fc2981d4fb28013ed3e (127.8.51.124:40803)
I20260809 08:00:41.757776 22980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e6c3b85db584927bb5b5642f2836d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "602e229d4dd84fc2981d4fb28013ed3e"
I20260809 08:00:41.757792 22898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e6c3b85db584927bb5b5642f2836d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec"
I20260809 08:00:41.757903 22980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:41.757903 22898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:41.759207 22980 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e6c3b85db584927bb5b5642f2836d74 in term 1.
I20260809 08:00:41.759210 22898 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e6c3b85db584927bb5b5642f2836d74 in term 1.
I20260809 08:00:41.759491 22791 leader_election.cc:302] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e6c3b85db584927bb5b5642f2836d74, 602e229d4dd84fc2981d4fb28013ed3e; no voters:
I20260809 08:00:41.759660 23040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:41.759825 23040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [term 1 LEADER]: Becoming Leader. State: Replica: 2e6c3b85db584927bb5b5642f2836d74, State: Running, Role: LEADER
I20260809 08:00:41.760062 23040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } }
I20260809 08:00:41.762162 23068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e6c3b85db584927bb5b5642f2836d74. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.762300 23068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:41.762635 23070 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:41.763429 23070 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:41.767949 22898 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [term 1 FOLLOWER]: Refusing update from remote peer 2e6c3b85db584927bb5b5642f2836d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:41.767988 22980 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [term 1 FOLLOWER]: Refusing update from remote peer 2e6c3b85db584927bb5b5642f2836d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:41.768589 23068 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:41.768738 23040 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:41.772441 23024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e6c3b85db584927bb5b5642f2836d74. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.772441 23039 sys_catalog.cc:455] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e6c3b85db584927bb5b5642f2836d74. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.772554 23024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.772554 23039 sys_catalog.cc:458] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.774204 23040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.774308 23040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:41.774611 23072 mvcc.cc:205] Tried to move back new op lower bound from 7316530961476083712 to 7316530961451540480. Current Snapshot: MvccSnapshot[applied={T|T < 7316530961476083712}]
I20260809 08:00:41.774813 23039 sys_catalog.cc:455] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.774909 23039 sys_catalog.cc:458] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.775615 23070 catalog_manager.cc:1347] Generated new cluster ID: 3242a6813bf64fb7a815732b25e7aedc
I20260809 08:00:41.775756 23070 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:41.776424 23068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.776559 23068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:41.777305 23024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e6c3b85db584927bb5b5642f2836d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e6c3b85db584927bb5b5642f2836d74" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 42211 } } peers { permanent_uuid: "fad2fef5ecab4f149f1b2ddab8f24bec" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 44409 } } peers { permanent_uuid: "602e229d4dd84fc2981d4fb28013ed3e" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 40803 } } }
I20260809 08:00:41.777405 23024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:00:41.794507 23070 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:00:41.795701 23070 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:41.806509 23070 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e6c3b85db584927bb5b5642f2836d74: Generated new TSK 0
I20260809 08:00:41.807343 23070 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:00:42.471832 23035 catalog_manager.cc:1259] Loaded cluster ID: 3242a6813bf64fb7a815732b25e7aedc
I20260809 08:00:42.471935 23035 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: loading cluster ID for follower catalog manager: success
I20260809 08:00:42.473696 23035 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: acquiring CA information for follower catalog manager: success
I20260809 08:00:42.474877 23035 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 602e229d4dd84fc2981d4fb28013ed3e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:00:42.491735 23052 catalog_manager.cc:1259] Loaded cluster ID: 3242a6813bf64fb7a815732b25e7aedc
I20260809 08:00:42.491804 23052 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: loading cluster ID for follower catalog manager: success
I20260809 08:00:42.493340 23052 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: acquiring CA information for follower catalog manager: success
I20260809 08:00:42.494432 23052 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fad2fef5ecab4f149f1b2ddab8f24bec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:00:42.872556 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22774
I20260809 08:00:42.880229 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22854
I20260809 08:00:42.886534 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 22932
2026-08-09T08:00:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3254 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:00:42 dist-test-slave-njxd krb5kdc[23087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:00:42 dist-test-slave-njxd krb5kdc[23087](info): set up 2 sockets
Aug 09 08:00:42 dist-test-slave-njxd krb5kdc[23087](info): commencing operation
krb5kdc: starting...
W20260809 08:00:43.925100 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:00:44.044118 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:39813
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:39813
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:44.149492 23100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:44.149791 23100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:44.149829 23100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:44.153589 23100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:44.153645 23100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:44.153671 23100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:44.153692 23100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:44.153707 23100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:44.158612 23100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:39813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:39813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:44.159519 23100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:44.160373 23100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:44.168716 23108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:44.168849 23100 server_base.cc:1034] running on GCE node
W20260809 08:00:44.168746 23106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:44.168689 23105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:44.169662 23100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:44.170730 23100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:44.171886 23100 hybrid_clock.cc:648] HybridClock initialized: now 1786262444171872 us; error 31 us; skew 500 ppm
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262444, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:44.174675 23100 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:44.175536 23100 webserver.cc:460] Webserver started at http://127.8.51.126:39323/ using document root <none> and password file <none>
I20260809 08:00:44.176092 23100 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:44.176183 23100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:44.176433 23100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:44.178519 23100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "11ae8012c80f403d9bb32981a34e25c7"
format_stamp: "Formatted at 2026-08-09 08:00:44 on dist-test-slave-njxd"
server_key: "4a922df3f9897e5cdfb70bd77db6add0"
server_key_iv: "3923b00d9ee46e7fabd800d8c0979038"
server_key_version: "encryptionkey@0"
I20260809 08:00:44.179065 23100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "11ae8012c80f403d9bb32981a34e25c7"
format_stamp: "Formatted at 2026-08-09 08:00:44 on dist-test-slave-njxd"
server_key: "4a922df3f9897e5cdfb70bd77db6add0"
server_key_iv: "3923b00d9ee46e7fabd800d8c0979038"
server_key_version: "encryptionkey@0"
I20260809 08:00:44.182752 23100 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:00:44.185012 23115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:44.186152 23100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:44.186280 23100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "11ae8012c80f403d9bb32981a34e25c7"
format_stamp: "Formatted at 2026-08-09 08:00:44 on dist-test-slave-njxd"
server_key: "4a922df3f9897e5cdfb70bd77db6add0"
server_key_iv: "3923b00d9ee46e7fabd800d8c0979038"
server_key_version: "encryptionkey@0"
I20260809 08:00:44.186383 23100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:44.200471 23100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:44.203536 23100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:44.203749 23100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:44.210443 23100 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:39813
I20260809 08:00:44.210456 23173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:39813 every 8 connection(s)
I20260809 08:00:44.211313 23100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:44.213907 23174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:44.218838 23174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: Bootstrap starting.
I20260809 08:00:44.220307 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23100
I20260809 08:00:44.220443 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:00:44.220695 8397 external_mini_cluster.cc:1428] Setting key 60b807d9d3a35476f59d21fd579c87fa
I20260809 08:00:44.221120 23174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:44.221957 23174 log.cc:824] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:44.223858 23174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: No bootstrap required, opened a new log
I20260809 08:00:44.227708 23174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } }
I20260809 08:00:44.227969 23174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:44.228041 23174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ae8012c80f403d9bb32981a34e25c7, State: Initialized, Role: FOLLOWER
I20260809 08:00:44.228516 23174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } }
I20260809 08:00:44.228637 23174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:44.228727 23174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:44.228855 23174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:44.229864 23174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } }
I20260809 08:00:44.230253 23174 leader_election.cc:302] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11ae8012c80f403d9bb32981a34e25c7; no voters:
I20260809 08:00:44.230580 23174 leader_election.cc:288] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:00:44.230885 23179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:44.231122 23179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [term 1 LEADER]: Becoming Leader. State: Replica: 11ae8012c80f403d9bb32981a34e25c7, State: Running, Role: LEADER
I20260809 08:00:44.231441 23179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } }
I20260809 08:00:44.231832 23174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:44.233111 23180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11ae8012c80f403d9bb32981a34e25c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } } }
I20260809 08:00:44.233244 23180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:44.233614 23181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11ae8012c80f403d9bb32981a34e25c7. Latest consensus state: current_term: 1 leader_uuid: "11ae8012c80f403d9bb32981a34e25c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ae8012c80f403d9bb32981a34e25c7" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 39813 } } }
I20260809 08:00:44.233785 23181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7 [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:44.235473 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:44.221751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.8.51.126:39813)
0809 08:00:44.222204 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:44.222219 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:44.222252 (+ 33us) server_negotiation.cc:407] Connection header received
0809 08:00:44.222819 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:44.222834 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:44.223119 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:44.223381 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:44.224240 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:44.225194 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:44.226370 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:44.226770 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:44.226878 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:44.229652 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:44.229660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:44.229678 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:44.229712 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:44.231678 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:44.232216 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:44.232222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:44.232228 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:44.232364 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:44.232719 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:44.232722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:44.232724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:44.233201 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:44.234312 (+ 1111us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:44.234468 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 08:00:44.234814 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":147,"threads_started":1}
W20260809 08:00:44.236876 23194 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:00:44.237000 23194 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:00:44.237085 23188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:44.237895 23188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:44.238193 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:00:44.242965 23188 catalog_manager.cc:1347] Generated new cluster ID: a977cb310f824bc6aa35ad4877454ee3
I20260809 08:00:44.243026 23188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:44.261444 23188 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:00:44.262353 23188 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:44.267724 23188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11ae8012c80f403d9bb32981a34e25c7: Generated new TSK 0
I20260809 08:00:44.268368 23188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:00:44.294700 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23100
2026-08-09T08:00:44Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1408 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23202](info): set up 2 sockets
Aug 09 08:00:44 dist-test-slave-njxd krb5kdc[23202](info): commencing operation
krb5kdc: starting...
W20260809 08:00:45.363449 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:00:45 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:00:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:00:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:00:45.486804 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:45.598098 23215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:45.598344 23215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:45.598413 23215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:45.602370 23215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:45.602422 23215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:45.602442 23215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:45.602458 23215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:45.602501 23215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:45.607733 23215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:45.608786 23215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:45.609876 23215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:45.618438 23222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:45.618433 23221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:45.618546 23215 server_base.cc:1034] running on GCE node
W20260809 08:00:45.618435 23224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:45.619236 23215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:45.620371 23215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:45.621565 23215 hybrid_clock.cc:648] HybridClock initialized: now 1786262445621553 us; error 32 us; skew 500 ppm
Aug 09 08:00:45 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262445, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:45.630849 23215 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:45.631865 23215 webserver.cc:460] Webserver started at http://127.8.51.126:46495/ using document root <none> and password file <none>
I20260809 08:00:45.632453 23215 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:45.632545 23215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:45.632793 23215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:45.635070 23215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "c7890119248a48e09d554419104f0e5f"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "53aa2519cfe254e2da7d6a2f21cef386"
server_key_iv: "b474a37965bb898443036ccf8c4f69ed"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.635672 23215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "c7890119248a48e09d554419104f0e5f"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "53aa2519cfe254e2da7d6a2f21cef386"
server_key_iv: "b474a37965bb898443036ccf8c4f69ed"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.639532 23215 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:00:45.641999 23231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:45.643292 23215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:45.643455 23215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c7890119248a48e09d554419104f0e5f"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "53aa2519cfe254e2da7d6a2f21cef386"
server_key_iv: "b474a37965bb898443036ccf8c4f69ed"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.643574 23215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:45.657255 23215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:45.660125 23215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:45.660346 23215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:45.667950 23215 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38671
I20260809 08:00:45.668243 23285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38671 every 8 connection(s)
I20260809 08:00:45.668960 23215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:45.671788 23287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:45.673475 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23215
I20260809 08:00:45.673617 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:00:45.673939 8397 external_mini_cluster.cc:1428] Setting key 79800f33e5c87ec8f05740050be4d9ac
I20260809 08:00:45.678315 23287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap starting.
I20260809 08:00:45.680866 23287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:45.681814 23287 log.cc:824] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Log is configured to *not* fsync() on all Append() calls
Aug 09 08:00:45 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:45.683770 23287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: No bootstrap required, opened a new log
I20260809 08:00:45.687316 23287 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:45.687544 23287 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:45.687637 23287 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7890119248a48e09d554419104f0e5f, State: Initialized, Role: FOLLOWER
I20260809 08:00:45.688041 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:45.675309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47974 (local address 127.8.51.126:38671)
0809 08:00:45.675736 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:45.675752 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:45.675786 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:00:45.676368 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:45.676384 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:45.676715 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:45.676979 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:45.677959 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.678981 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.680156 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.680594 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.680712 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:45.683533 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:45.683538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:45.683550 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:45.683575 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:45.685217 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:45.685689 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:45.685694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:45.685698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:45.685802 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:45.686084 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:45.686086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:45.686088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:45.686453 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:45.686669 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:45.686953 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 08:00:45.687215 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":133,"threads_started":1}
I20260809 08:00:45.688053 23287 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:45.688318 23287 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:45.688402 23287 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:45.688524 23287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:45.689371 23287 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:45.689774 23287 leader_election.cc:302] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7890119248a48e09d554419104f0e5f; no voters:
I20260809 08:00:45.690093 23287 leader_election.cc:288] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:00:45.690164 23292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:45.690452 23292 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 LEADER]: Becoming Leader. State: Replica: c7890119248a48e09d554419104f0e5f, State: Running, Role: LEADER
I20260809 08:00:45.690742 23292 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:45.691398 23287 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:45.692423 23294 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7890119248a48e09d554419104f0e5f. Latest consensus state: current_term: 1 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:45.692548 23294 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:45.692988 23302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:45.692945 23293 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:45.693756 23293 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:45.696066 23302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:45.701920 23302 catalog_manager.cc:1347] Generated new cluster ID: cf749197bed94eea90b9da73484a5b54
I20260809 08:00:45.701988 23302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:45.711225 23302 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:00:45.712040 23302 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:45.718308 23302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Generated new TSK 0
I20260809 08:00:45.718945 23302 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:00:45.754606 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:45.866401 23314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:45.866694 23314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:45.866773 23314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:45.870803 23314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:45.870855 23314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:45.870954 23314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:00:45.876215 23314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:45.877298 23314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:45.878542 23314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:45.888088 23321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:45.888069 23324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:45.888283 23322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:45.888554 23314 server_base.cc:1034] running on GCE node
I20260809 08:00:45.888942 23314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:45.889562 23314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:45.890801 23314 hybrid_clock.cc:648] HybridClock initialized: now 1786262445890773 us; error 40 us; skew 500 ppm
Aug 09 08:00:45 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262445, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:45.893694 23314 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:00:45.894543 23314 webserver.cc:460] Webserver started at http://127.8.51.65:42701/ using document root <none> and password file <none>
I20260809 08:00:45.895120 23314 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:45.895244 23314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:45.895483 23314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:45.897428 23314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "19e2275590e84dee8d832aaf9ca3b570"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "20d697a1fce5860ee365894c2b600bdb"
server_key_iv: "2168c1fdd356aed0803ee84e20762409"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.898036 23314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "19e2275590e84dee8d832aaf9ca3b570"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "20d697a1fce5860ee365894c2b600bdb"
server_key_iv: "2168c1fdd356aed0803ee84e20762409"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.901556 23314 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:00:45.903927 23332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:45.905045 23314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 08:00:45.905179 23314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "19e2275590e84dee8d832aaf9ca3b570"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "20d697a1fce5860ee365894c2b600bdb"
server_key_iv: "2168c1fdd356aed0803ee84e20762409"
server_key_version: "encryptionkey@0"
I20260809 08:00:45.905284 23314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:45.922108 23314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:45.924875 23314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:45.925078 23314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:45.925696 23314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:45.926489 23314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:45.926561 23314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:45.926637 23314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:45.926681 23314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:45.935374 23314 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:40609
I20260809 08:00:45.935400 23452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:40609 every 8 connection(s)
I20260809 08:00:45.936596 23314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:00:45.941764 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23314
I20260809 08:00:45.941898 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:00:45.942190 8397 external_mini_cluster.cc:1428] Setting key 0afcbd8bd6cfac24c94fa366014a21f1
Aug 09 08:00:45 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262445, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:45.952395 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:45.938513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:48649 (local address 127.8.51.126:38671)
0809 08:00:45.938663 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:45.938667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:45.939479 (+ 812us) server_negotiation.cc:407] Connection header received
0809 08:00:45.940826 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:45.940830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:45.940888 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:45.940992 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:45.942587 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.943314 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.945099 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.945330 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.945407 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:45.948463 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:45.948469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:45.948475 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:45.948535 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:45.950312 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:45.950801 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:45.950807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:45.950811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:45.950909 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:45.951245 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:45.951249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:45.951250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:45.951490 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:45.951599 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:45.952077 (+ 478us) server_negotiation.cc:299] Negotiation successful
0809 08:00:45.952213 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 08:00:45.953120 23455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:45.938890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:48649)
0809 08:00:45.939327 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:45.939371 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:45.940606 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:45.941180 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:45.941187 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:45.941707 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:45.942403 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:45.942423 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.943508 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.943519 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:45.944951 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:45.944967 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:45.945495 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:45.945502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:45.945775 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:45.946506 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:45.946523 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:45.948294 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:45.950423 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:45.950427 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:45.950440 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:45.950682 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:45.951009 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:45.951011 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:45.951013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:45.951147 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:45.951597 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:45.951602 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:45.951827 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 08:00:45.951979 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 08:00:45.952243 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:00:45.954381 23453 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:45.954667 23453 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:45.955159 23453 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 08:00:45.956768 23250 ts_manager.cc:194] Registered new tserver with Master: 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65:40609)
I20260809 08:00:45.958357 23250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:48649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:00:45.973021 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:46.083807 23458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:46.084085 23458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:46.084170 23458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:46.088064 23458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:46.088142 23458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:46.088233 23458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:00:46.093484 23458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:46.094465 23458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:46.095530 23458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:46.105096 23464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.105201 23458 server_base.cc:1034] running on GCE node
W20260809 08:00:46.105093 23463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.105373 23466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.105823 23458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:46.106434 23458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:46.107617 23458 hybrid_clock.cc:648] HybridClock initialized: now 1786262446107581 us; error 47 us; skew 500 ppm
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:46.110567 23458 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:00:46.111450 23458 webserver.cc:460] Webserver started at http://127.8.51.66:34351/ using document root <none> and password file <none>
I20260809 08:00:46.112008 23458 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:46.112077 23458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:46.112322 23458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:46.114449 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "9f88411fbf9931333543c09ef5c41c98"
server_key_iv: "dbd69cefd00bc0c00da36a3f14c616d9"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.115052 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "9f88411fbf9931333543c09ef5c41c98"
server_key_iv: "dbd69cefd00bc0c00da36a3f14c616d9"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.118989 23458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 08:00:46.121493 23473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.122768 23458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:46.122907 23458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "9f88411fbf9931333543c09ef5c41c98"
server_key_iv: "dbd69cefd00bc0c00da36a3f14c616d9"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.123050 23458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:46.137005 23458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:46.140311 23458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:46.140533 23458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:46.141170 23458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:46.142192 23458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:46.142266 23458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.142338 23458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:46.142392 23458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.151691 23458 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:36713
I20260809 08:00:46.151713 23593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:36713 every 8 connection(s)
I20260809 08:00:46.152668 23458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:00:46.159536 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23458
I20260809 08:00:46.159679 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:00:46.160013 8397 external_mini_cluster.cc:1428] Setting key b5a26b3595b31b191f69eab4dfee36b2
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:46.168159 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.154591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:32863 (local address 127.8.51.126:38671)
0809 08:00:46.154756 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.154759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.155625 (+ 866us) server_negotiation.cc:407] Connection header received
0809 08:00:46.156995 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.156998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.157070 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.157173 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:46.158478 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.159033 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.160673 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.160911 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.161034 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.164034 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:46.164038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:46.164040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:46.164064 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:46.165826 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.166339 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.166345 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.166350 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.166452 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.166797 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.166804 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.166809 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.167102 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:46.167221 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.167733 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.167888 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 08:00:46.168809 23596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.154992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:32863)
0809 08:00:46.155444 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.155488 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.156759 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.157360 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.157367 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.157834 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:46.158328 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.158341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.159171 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.159175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.160545 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.160555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.161066 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.161070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.161247 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.161955 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:46.161977 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:46.163820 (+ 1843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:46.165942 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:46.165947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:46.165959 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:46.166232 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:46.166549 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:46.166551 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:46.166552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:46.166693 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:46.167225 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:46.167231 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:46.167473 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.167636 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.167904 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":122,"threads_started":1}
I20260809 08:00:46.170076 23594 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:46.170349 23594 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:46.170841 23594 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:00:46.171932 23250 ts_manager.cc:194] Registered new tserver with Master: b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713)
I20260809 08:00:46.172513 23250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:32863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:00:46.191009 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:46.302927 23600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:46.303182 23600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:46.303264 23600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:46.307041 23600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:46.307118 23600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:46.307194 23600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:00:46.312119 23600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:46.313053 23600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:46.314044 23600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:46.323132 23605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.323132 23607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.323230 23600 server_base.cc:1034] running on GCE node
W20260809 08:00:46.323150 23609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.323766 23600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:46.324337 23600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:46.325518 23600 hybrid_clock.cc:648] HybridClock initialized: now 1786262446325501 us; error 27 us; skew 500 ppm
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:46.328253 23600 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:00:46.329133 23600 webserver.cc:460] Webserver started at http://127.8.51.67:34835/ using document root <none> and password file <none>
I20260809 08:00:46.329759 23600 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:46.329849 23600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:46.330080 23600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:00:46.331990 23600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "b01f54c94fd04797b36af47d7ef87773"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "5e0c9d925efd60523f5f9b01b95309ec"
server_key_iv: "0245770de1a136902fb5463e6be79b83"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.332544 23600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "b01f54c94fd04797b36af47d7ef87773"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "5e0c9d925efd60523f5f9b01b95309ec"
server_key_iv: "0245770de1a136902fb5463e6be79b83"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.336410 23600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 08:00:46.338850 23616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.340036 23600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:00:46.340168 23600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "b01f54c94fd04797b36af47d7ef87773"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "5e0c9d925efd60523f5f9b01b95309ec"
server_key_iv: "0245770de1a136902fb5463e6be79b83"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.340273 23600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:46.379184 23600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:46.382124 23600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:46.382331 23600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:46.382936 23600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:46.383785 23600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:46.383857 23600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.383942 23600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:46.383985 23600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.392980 23600 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36143
I20260809 08:00:46.393035 23733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36143 every 8 connection(s)
I20260809 08:00:46.393896 23600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:00:46.398425 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23600
I20260809 08:00:46.398522 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:00:46.398813 8397 external_mini_cluster.cc:1428] Setting key 7426b7b874d74a781575b12b937923c6
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:46.407038 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.395658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:55393 (local address 127.8.51.126:38671)
0809 08:00:46.395811 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.395815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.396871 (+ 1056us) server_negotiation.cc:407] Connection header received
0809 08:00:46.397687 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.397689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.397734 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.397805 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:46.399040 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.399731 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.400865 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.401085 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.401193 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.403679 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:46.403682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:46.403693 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:46.403718 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:46.404967 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.405481 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.405484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.405486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.405568 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.405954 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.405959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.405961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.406146 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:46.406253 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.406741 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.406868 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 08:00:46.407814 23737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.396096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:55393)
0809 08:00:46.396717 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.396756 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.397486 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.397960 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.397966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.398316 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:46.398877 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.398900 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.399863 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.399866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.400734 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.400743 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.401239 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.401243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.401412 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.402038 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:46.402055 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:46.403516 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:46.405089 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:46.405095 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:46.405110 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:46.405369 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:46.405712 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:46.405715 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:46.405718 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:46.405858 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:46.406253 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:46.406261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:46.406503 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.406692 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.407013 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":126,"threads_started":1}
I20260809 08:00:46.408942 23735 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:46.409158 23735 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:46.409680 23735 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
I20260809 08:00:46.410656 23250 ts_manager.cc:194] Registered new tserver with Master: b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
I20260809 08:00:46.411350 23250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:55393
I20260809 08:00:46.412678 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:00:46.422003 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.414766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47976 (local address 127.8.51.126:38671)
0809 08:00:46.414902 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.414907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.415097 (+ 190us) server_negotiation.cc:407] Connection header received
0809 08:00:46.415244 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.415247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.415290 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.415369 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:46.416075 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.416566 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.417425 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.417741 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.417842 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.419099 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:46.419103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:46.419105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:46.419129 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:46.420308 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.420738 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.420742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.420744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.420821 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:46.421087 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:46.421091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:46.421093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:46.421323 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:46.421458 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.421737 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.421849 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:00:46.424794 23249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:00:46.428017 23249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:00:46.442392 23752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.436968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.8.51.67:36143)
0809 08:00:46.437319 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.437330 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.437347 (+ 17us) server_negotiation.cc:407] Connection header received
0809 08:00:46.437410 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.437427 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.437636 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.437984 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:46.438283 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.439219 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.440789 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.441684 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.441801 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.441968 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.442127 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.442243 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":145,"threads_started":1}
I20260809 08:00:46.442384 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.436417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36143 (local address 127.0.0.1:41626)
0809 08:00:46.436945 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.436958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.437032 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.437823 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.437830 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.437867 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:46.438093 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.438102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.439339 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.439343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.440636 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.440646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.441816 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.441820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.441934 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.441982 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.442095 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.442218 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":17,"spinlock_wait_cycles":5632,"thread_start_us":94,"threads_started":1}
I20260809 08:00:46.442461 23747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.436253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:40609 (local address 127.0.0.1:50030)
0809 08:00:46.436727 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.436778 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.436907 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.437823 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.437830 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.437869 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:46.438304 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.438311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.439738 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.439742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.440869 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.440877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.442046 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.442051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.442144 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.442167 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.442247 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.442315 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":75,"spinlock_wait_cycles":8064,"thread_start_us":95,"threads_started":1}
I20260809 08:00:46.442683 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.436982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.0.0.1:40388)
0809 08:00:46.438242 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.438257 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.438344 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.438817 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.438820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.438838 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:46.438924 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.438929 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.440112 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.440118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.441159 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.441168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.442297 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.442301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.442378 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.442407 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.442482 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.442553 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1167,"thread_start_us":100,"threads_started":1}
I20260809 08:00:46.442951 23750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.436420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50030 (local address 127.8.51.65:40609)
0809 08:00:46.437243 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.437262 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.437287 (+ 25us) server_negotiation.cc:407] Connection header received
0809 08:00:46.437371 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.437377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.437642 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.437948 (+ 306us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:46.438437 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.439597 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.440995 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.441826 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.441916 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.442030 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.442722 (+ 692us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.442817 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":138,"threads_started":1}
I20260809 08:00:46.443152 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.437408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40388 (local address 127.8.51.66:36713)
0809 08:00:46.438363 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.438376 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.438400 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:00:46.438476 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.438483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.438666 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.438818 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:46.439019 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.439987 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.441284 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.441978 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.442101 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.442236 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.442857 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.442985 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":204,"threads_started":1}
I20260809 08:00:46.446074 23381 tablet_service.cc:1467] Processing CreateTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (DEFAULT_TABLE table=test-table [id=f6f8e470f3b2419c931c6919a764a7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:46.446074 23666 tablet_service.cc:1467] Processing CreateTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (DEFAULT_TABLE table=test-table [id=f6f8e470f3b2419c931c6919a764a7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:46.447275 23381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:46.447276 23666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:46.448997 23524 tablet_service.cc:1467] Processing CreateTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (DEFAULT_TABLE table=test-table [id=f6f8e470f3b2419c931c6919a764a7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:46.450042 23524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:46.455446 23754 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap starting.
I20260809 08:00:46.455446 23755 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Bootstrap starting.
I20260809 08:00:46.456759 23756 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Bootstrap starting.
I20260809 08:00:46.457787 23754 tablet_bootstrap.cc:654] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:46.458222 23755 tablet_bootstrap.cc:654] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:46.458741 23754 log.cc:824] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:46.459072 23755 log.cc:824] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:46.459544 23756 tablet_bootstrap.cc:654] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:46.460376 23756 log.cc:824] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:46.460810 23754 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: No bootstrap required, opened a new log
I20260809 08:00:46.461030 23754 ts_tablet_manager.cc:1397] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 08:00:46.461211 23755 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: No bootstrap required, opened a new log
I20260809 08:00:46.461400 23755 ts_tablet_manager.cc:1397] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 08:00:46.462324 23756 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: No bootstrap required, opened a new log
I20260809 08:00:46.462497 23756 ts_tablet_manager.cc:1397] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 08:00:46.464620 23754 raft_consensus.cc:348] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.464999 23754 raft_consensus.cc:374] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:46.465116 23754 raft_consensus.cc:729] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Initialized, Role: FOLLOWER
I20260809 08:00:46.465230 23755 raft_consensus.cc:348] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.465498 23755 raft_consensus.cc:374] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:46.465556 23755 raft_consensus.cc:729] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01f54c94fd04797b36af47d7ef87773, State: Initialized, Role: FOLLOWER
I20260809 08:00:46.465675 23754 consensus_queue.cc:260] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.466008 23755 consensus_queue.cc:260] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.466168 23756 raft_consensus.cc:348] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.466408 23453 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
I20260809 08:00:46.466508 23756 raft_consensus.cc:374] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:46.466614 23756 raft_consensus.cc:729] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ec8c50ac7c42dcbed89badb1ac5d71, State: Initialized, Role: FOLLOWER
I20260809 08:00:46.466792 23754 ts_tablet_manager.cc:1428] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 08:00:46.467022 23755 ts_tablet_manager.cc:1428] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260809 08:00:46.467078 23756 consensus_queue.cc:260] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.467408 23735 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
I20260809 08:00:46.467657 23594 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
I20260809 08:00:46.467839 23756 ts_tablet_manager.cc:1428] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 08:00:46.549401 23760 raft_consensus.cc:482] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:46.549737 23760 raft_consensus.cc:504] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.550899 23760 leader_election.cc:288] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143), b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713)
I20260809 08:00:46.555059 23752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.551314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:36151 (local address 127.8.51.67:36143)
0809 08:00:46.551460 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.551464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.551680 (+ 216us) server_negotiation.cc:407] Connection header received
0809 08:00:46.551885 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.551888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.551948 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.552075 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:46.552371 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.552877 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.554044 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.554481 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.554607 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.554674 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.554873 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.554939 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 08:00:46.555088 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.551219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36143 (local address 127.8.51.65:36151)
0809 08:00:46.551560 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.551578 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.551703 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.552091 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.552094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.552116 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:46.552254 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.552259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.552996 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.552999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.553895 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.553905 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.554638 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.554642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.554744 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.554762 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.554855 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.554924 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":2,"thread_start_us":152,"threads_started":1}
I20260809 08:00:46.555576 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.551710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.8.51.65:35739)
0809 08:00:46.552028 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.552041 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:46.552136 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:46.552384 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:46.552387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:46.552402 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:46.552526 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.552531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.553241 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.553246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.554192 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:46.554201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.555052 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.555056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:46.555147 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.555290 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 08:00:46.555358 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 08:00:46.555427 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":17,"thread_start_us":112,"threads_started":1}
I20260809 08:00:46.555600 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.551897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:35739 (local address 127.8.51.66:36713)
0809 08:00:46.552052 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.552059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.552100 (+ 41us) server_negotiation.cc:407] Connection header received
0809 08:00:46.552234 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.552237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.552281 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.552375 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:46.552635 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.553121 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.554311 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.554821 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.554933 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.554993 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.555402 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.555481 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 08:00:46.555678 23686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9a7a3bd9d8f48a6ad3a4c607ea04bef" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01f54c94fd04797b36af47d7ef87773" is_pre_election: true
I20260809 08:00:46.556007 23686 raft_consensus.cc:2454] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 0.
I20260809 08:00:46.556118 23544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9a7a3bd9d8f48a6ad3a4c607ea04bef" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" is_pre_election: true
I20260809 08:00:46.556375 23544 raft_consensus.cc:2454] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 0.
I20260809 08:00:46.556500 23335 leader_election.cc:302] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570, b01f54c94fd04797b36af47d7ef87773; no voters:
I20260809 08:00:46.556767 23760 raft_consensus.cc:2781] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:00:46.556855 23760 raft_consensus.cc:482] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:00:46.556900 23760 raft_consensus.cc:3037] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:46.557988 23760 raft_consensus.cc:504] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.558337 23760 leader_election.cc:288] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 election: Requested vote from peers b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143), b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713)
I20260809 08:00:46.558691 23686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9a7a3bd9d8f48a6ad3a4c607ea04bef" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01f54c94fd04797b36af47d7ef87773"
I20260809 08:00:46.558730 23544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9a7a3bd9d8f48a6ad3a4c607ea04bef" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
I20260809 08:00:46.558816 23686 raft_consensus.cc:3037] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:46.558849 23544 raft_consensus.cc:3037] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:46.559885 23544 raft_consensus.cc:2454] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 1.
I20260809 08:00:46.559895 23686 raft_consensus.cc:2454] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 1.
I20260809 08:00:46.560163 23335 leader_election.cc:302] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570, b4ec8c50ac7c42dcbed89badb1ac5d71; no voters:
I20260809 08:00:46.560334 23760 raft_consensus.cc:2781] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:46.560544 23760 raft_consensus.cc:686] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 LEADER]: Becoming Leader. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Running, Role: LEADER
I20260809 08:00:46.560871 23760 consensus_queue.cc:237] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:46.564226 23249 catalog_manager.cc:5495] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "19e2275590e84dee8d832aaf9ca3b570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260809 08:00:46.593366 23750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.589847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50042 (local address 127.8.51.65:40609)
0809 08:00:46.589970 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:46.589975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:46.590029 (+ 54us) server_negotiation.cc:407] Connection header received
0809 08:00:46.590102 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:46.590104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:46.590158 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:46.590238 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:00:46.590440 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.590943 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.591861 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:46.592139 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:46.592268 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:46.592561 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:00:46.592981 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:00:46.593080 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:46.593132 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 08:00:46.593216 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 08:00:46.599274 23544 raft_consensus.cc:1261] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Refusing update from remote peer 19e2275590e84dee8d832aaf9ca3b570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:46.599295 23686 raft_consensus.cc:1261] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Refusing update from remote peer 19e2275590e84dee8d832aaf9ca3b570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:46.600011 23760 consensus_queue.cc:1035] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:46.600235 23765 consensus_queue.cc:1035] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:46.617443 23250 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:46.617656 23250 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:46.620092 23250 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Sending DeleteTablet for 3 replicas of tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef
I20260809 08:00:46.620854 23381 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:46 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:50030
I20260809 08:00:46.620985 23524 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:46 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:40388
I20260809 08:00:46.620986 23666 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:46 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:41626
I20260809 08:00:46.621524 23780 tablet_replica.cc:330] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: stopping tablet replica
I20260809 08:00:46.621639 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23314
I20260809 08:00:46.621670 23778 tablet_replica.cc:330] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: stopping tablet replica
I20260809 08:00:46.621939 23778 raft_consensus.cc:2229] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:00:46.621940 23780 raft_consensus.cc:2229] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:46.622334 23780 raft_consensus.cc:2258] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:46.622718 23779 tablet_replica.cc:330] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: stopping tablet replica
I20260809 08:00:46.623065 23779 raft_consensus.cc:2229] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:46.623423 23779 raft_consensus.cc:2258] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:46.623879 23780 ts_tablet_manager.cc:1905] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:46.625130 23779 ts_tablet_manager.cc:1905] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:46.626829 23780 ts_tablet_manager.cc:1918] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:46.626991 23780 log.cc:1196] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/a9a7a3bd9d8f48a6ad3a4c607ea04bef
I20260809 08:00:46.627373 23780 ts_tablet_manager.cc:1939] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting consensus metadata
I20260809 08:00:46.628458 23235 catalog_manager.cc:4841] TS b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (table test-table [id=f6f8e470f3b2419c931c6919a764a7c7]) successfully deleted
I20260809 08:00:46.628500 23779 ts_tablet_manager.cc:1918] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:46.628593 23779 log.cc:1196] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/a9a7a3bd9d8f48a6ad3a4c607ea04bef
I20260809 08:00:46.628978 23779 ts_tablet_manager.cc:1939] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P b01f54c94fd04797b36af47d7ef87773: Deleting consensus metadata
I20260809 08:00:46.630159 23235 catalog_manager.cc:4841] TS b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (table test-table [id=f6f8e470f3b2419c931c6919a764a7c7]) successfully deleted
W20260809 08:00:46.633667 23233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:40609 (error 108)
I20260809 08:00:46.633725 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23458
I20260809 08:00:46.636184 23747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:46.635719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:40609 (local address 127.0.0.1:50048)
0809 08:00:46.636028 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:46.636091 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:40609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220}
W20260809 08:00:46.638199 23233 catalog_manager.cc:4584] TS 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65:40609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef: Network error: Client connection negotiation failed: client connection to 127.8.51.65:40609: connect: Connection refused (error 111)
I20260809 08:00:46.644096 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23600
I20260809 08:00:46.651546 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23215
I20260809 08:00:46.659443 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--webserver_interface=127.8.51.126
--webserver_port=46495
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:46.768684 23782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:46.768940 23782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:46.768980 23782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:46.773144 23782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:46.773205 23782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:46.773226 23782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:46.773241 23782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:46.773257 23782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:46.778544 23782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=46495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:46.779580 23782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:46.780587 23782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:46.794946 23790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.794958 23789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.794941 23792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.795135 23782 server_base.cc:1034] running on GCE node
I20260809 08:00:46.795876 23782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:46.797025 23782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:46.798233 23782 hybrid_clock.cc:648] HybridClock initialized: now 1786262446798215 us; error 25 us; skew 500 ppm
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:46.800992 23782 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:46.802002 23782 webserver.cc:460] Webserver started at http://127.8.51.126:46495/ using document root <none> and password file <none>
I20260809 08:00:46.802599 23782 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:46.802718 23782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:46.806699 23782 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:00:46.809370 23799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:46.810659 23782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:46.810806 23782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c7890119248a48e09d554419104f0e5f"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "53aa2519cfe254e2da7d6a2f21cef386"
server_key_iv: "b474a37965bb898443036ccf8c4f69ed"
server_key_version: "encryptionkey@0"
I20260809 08:00:46.811414 23782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:46.837687 23782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:46.840626 23782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:46.840831 23782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:46.848099 23782 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38671
I20260809 08:00:46.848392 23852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38671 every 8 connection(s)
I20260809 08:00:46.849241 23782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:46.853400 23853 sys_catalog.cc:263] Verifying existing consensus state
I20260809 08:00:46.855161 23853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap starting.
I20260809 08:00:46.856696 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23782
I20260809 08:00:46.857167 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:40609
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=42701
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:46.872453 23853 log.cc:824] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:46.881029 23853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:00:46.881422 23853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap complete.
I20260809 08:00:46.885465 23853 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:46.885914 23853 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7890119248a48e09d554419104f0e5f, State: Initialized, Role: FOLLOWER
I20260809 08:00:46.886438 23853 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:46.886561 23853 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:46.886654 23853 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:46.886780 23853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 1 FOLLOWER]: Advancing to term 2
I20260809 08:00:46.888592 23853 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:46.888926 23853 leader_election.cc:302] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7890119248a48e09d554419104f0e5f; no voters:
I20260809 08:00:46.889227 23853 leader_election.cc:288] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 08:00:46.889398 23857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260809 08:00:46.889681 23857 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 LEADER]: Becoming Leader. State: Replica: c7890119248a48e09d554419104f0e5f, State: Running, Role: LEADER
I20260809 08:00:46.889991 23857 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:46.890453 23853 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:46.891327 23858 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:46.891455 23858 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:46.892167 23859 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7890119248a48e09d554419104f0e5f. Latest consensus state: current_term: 2 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:46.892284 23859 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:46.895543 23874 catalog_manager.cc:1259] Loaded cluster ID: cf749197bed94eea90b9da73484a5b54
I20260809 08:00:46.895608 23874 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: loading cluster ID for follower catalog manager: success
W20260809 08:00:46.896569 23874 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260809 08:00:46.896644 23874 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260809 08:00:46.896708 23866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:46.899214 23866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:46.899717 23866 catalog_manager.cc:1259] Loaded cluster ID: cf749197bed94eea90b9da73484a5b54
I20260809 08:00:46.899782 23866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:00:46.900820 23866 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 08:00:46.905694 23866 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 08:00:46.911121 23866 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:00:46.911823 23866 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Loaded TSK: 0
I20260809 08:00:46.912981 23866 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 08:00:46.972496 23855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:46.972800 23855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:46.972872 23855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:46.976987 23855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:46.977077 23855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:46.977170 23855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:00:46.982363 23855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:40609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=42701
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:46.983433 23855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:46.984398 23855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:46.994966 23883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.994968 23884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:46.994968 23886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:46.995501 23855 server_base.cc:1034] running on GCE node
I20260809 08:00:46.995916 23855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:46.996565 23855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:46.997725 23855 hybrid_clock.cc:648] HybridClock initialized: now 1786262446997694 us; error 41 us; skew 500 ppm
Aug 09 08:00:46 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:47.000566 23855 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:00:47.001382 23855 webserver.cc:460] Webserver started at http://127.8.51.65:42701/ using document root <none> and password file <none>
I20260809 08:00:47.001962 23855 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:47.002071 23855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:47.005949 23855 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:00:47.008082 23893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.009349 23855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:47.009486 23855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "19e2275590e84dee8d832aaf9ca3b570"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "20d697a1fce5860ee365894c2b600bdb"
server_key_iv: "2168c1fdd356aed0803ee84e20762409"
server_key_version: "encryptionkey@0"
I20260809 08:00:47.010062 23855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:47.049467 23855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:47.052393 23855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:47.052606 23855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:47.053231 23855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:47.054378 23900 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 08:00:47.058547 23855 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 08:00:47.058738 23855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260809 08:00:47.058846 23855 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 08:00:47.060554 23855 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 08:00:47.060626 23855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 08:00:47.060966 23900 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap starting.
I20260809 08:00:47.071440 23855 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:40609
I20260809 08:00:47.072763 23855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:00:47.073683 24013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:40609 every 8 connection(s)
I20260809 08:00:47.074808 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 23855
I20260809 08:00:47.075269 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:36713
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=34351
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:47.082285 23900 log.cc:824] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:47.090247 23900 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:47.090706 23900 tablet_bootstrap.cc:492] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap complete.
I20260809 08:00:47.092226 23900 ts_tablet_manager.cc:1397] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Time spent bootstrapping tablet: real 0.031s user 0.027s sys 0.004s
I20260809 08:00:47.094650 23900 raft_consensus.cc:348] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:47.095232 23900 raft_consensus.cc:729] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Initialized, Role: FOLLOWER
I20260809 08:00:47.095765 23900 consensus_queue.cc:260] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } }
I20260809 08:00:47.096812 23900 ts_tablet_manager.cc:1428] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:00:47.097878 24017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.078870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:55101)
0809 08:00:47.080254 (+ 1384us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.080313 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.081237 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.082838 (+ 1601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.082846 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.083269 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:47.083895 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.083915 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.085957 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.085960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.087204 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.087216 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.088345 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.088349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.088546 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.089249 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:47.089269 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:47.091377 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:47.094462 (+ 3085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.094467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.094479 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.094912 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.095372 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.095375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.095377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.095544 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.096376 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:47.096382 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:47.096647 (+ 265us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.096831 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.097129 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1145,"thread_start_us":147,"threads_started":1}
I20260809 08:00:47.099136 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.080214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:55101 (local address 127.8.51.126:38671)
0809 08:00:47.081818 (+ 1604us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.081834 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.081868 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:00:47.082068 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.082077 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.082370 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.082766 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:47.084106 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.085771 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.087349 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.088187 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.088354 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.091572 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:47.091578 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:47.091595 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:47.091633 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:47.094332 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.095045 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.095052 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.095061 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.095237 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.095660 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.095663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.095665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.096243 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:47.097749 (+ 1506us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.097894 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.098297 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1483,"thread_start_us":132,"threads_started":1}
I20260809 08:00:47.101219 24014 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:47.101432 24014 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:47.101941 24014 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
I20260809 08:00:47.104066 23816 ts_manager.cc:194] Registered new tserver with Master: 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65:40609)
I20260809 08:00:47.107095 23816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:55101
I20260809 08:00:47.109443 24014 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262446, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 08:00:47.117221 24021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.106599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:40609 (local address 127.0.0.1:50050)
0809 08:00:47.106968 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.107007 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.107124 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.107857 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.107863 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.108208 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:47.108303 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.108309 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.109271 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.109274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.110146 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.110156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.110882 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.110885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.110992 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.111563 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:47.111576 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:47.113093 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:47.115435 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.115443 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.115447 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.115722 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.116056 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.116059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.116061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.116165 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.116711 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:47.116716 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:47.116809 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.116916 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.117084 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":94,"threads_started":1}
I20260809 08:00:47.117372 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.106692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50050 (local address 127.8.51.65:40609)
0809 08:00:47.107325 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.107336 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.107356 (+ 20us) server_negotiation.cc:407] Connection header received
0809 08:00:47.107430 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.107435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.107610 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.107747 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:47.108425 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.109132 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.110291 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.110760 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.110858 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.113217 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:47.113225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:47.113237 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:47.113260 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:47.115332 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.115838 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.115844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.115846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.115942 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.116258 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.116261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.116263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.116595 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:47.116732 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.117034 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.117221 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":91,"threads_started":1}
I20260809 08:00:47.118338 23946 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:46 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:50050
I20260809 08:00:47.119182 24023 tablet_replica.cc:330] stopping tablet replica
I20260809 08:00:47.119468 24023 raft_consensus.cc:2229] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:47.119714 24023 raft_consensus.cc:2258] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:47.120654 24023 ts_tablet_manager.cc:1905] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:47.124174 24023 ts_tablet_manager.cc:1918] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:47.124255 24023 log.cc:1196] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/a9a7a3bd9d8f48a6ad3a4c607ea04bef
I20260809 08:00:47.124521 24023 ts_tablet_manager.cc:1939] T a9a7a3bd9d8f48a6ad3a4c607ea04bef P 19e2275590e84dee8d832aaf9ca3b570: Deleting consensus metadata
I20260809 08:00:47.126143 23801 catalog_manager.cc:4841] TS 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65:40609): tablet a9a7a3bd9d8f48a6ad3a4c607ea04bef (table test-table [id=f6f8e470f3b2419c931c6919a764a7c7]) successfully deleted
W20260809 08:00:47.193935 24016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:47.194203 24016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:47.194276 24016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:47.198242 24016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:47.198326 24016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:47.198418 24016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:00:47.203384 24016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:36713
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=34351
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:47.204367 24016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:47.205377 24016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:47.214774 24029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:47.214774 24028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:47.214797 24031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:47.215209 24016 server_base.cc:1034] running on GCE node
I20260809 08:00:47.215782 24016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:47.216444 24016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:47.217646 24016 hybrid_clock.cc:648] HybridClock initialized: now 1786262447217624 us; error 37 us; skew 500 ppm
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262447, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:47.220423 24016 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:00:47.221340 24016 webserver.cc:460] Webserver started at http://127.8.51.66:34351/ using document root <none> and password file <none>
I20260809 08:00:47.221971 24016 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:47.222078 24016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:47.225946 24016 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:00:47.227977 24038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.229230 24016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:47.229375 24016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "9f88411fbf9931333543c09ef5c41c98"
server_key_iv: "dbd69cefd00bc0c00da36a3f14c616d9"
server_key_version: "encryptionkey@0"
I20260809 08:00:47.230017 24016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:47.244004 24016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:47.246837 24016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:47.247036 24016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:47.247643 24016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:47.248476 24016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:47.248546 24016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.248618 24016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:47.248660 24016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.257658 24016 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:36713
I20260809 08:00:47.257687 24156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:36713 every 8 connection(s)
I20260809 08:00:47.258677 24016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:00:47.263713 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24016
I20260809 08:00:47.264108 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:36143
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=34835
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262447, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:47.273332 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.260469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:43935 (local address 127.8.51.126:38671)
0809 08:00:47.260613 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.260616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.261401 (+ 785us) server_negotiation.cc:407] Connection header received
0809 08:00:47.262756 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.262759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.262817 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.262933 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:47.264142 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.264718 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.265999 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.266237 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.266347 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.269082 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:47.269089 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:47.269095 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:47.269134 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:47.271071 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.271592 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.271597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.271599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.271714 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.272072 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.272078 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.272082 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.272368 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:47.272486 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.272933 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.273093 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:00:47.273964 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.260834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:43935)
0809 08:00:47.261262 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.261302 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.262523 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.263143 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.263150 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.263487 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:47.264000 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.264014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.264836 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.264840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.265874 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.265884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.266387 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.266391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.266553 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.267158 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:47.267175 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:47.268841 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:47.271207 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.271213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.271233 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.271486 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.271829 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.271831 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.271832 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.271959 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.272470 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:47.272475 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:47.272692 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.272844 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.273086 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
I20260809 08:00:47.275228 24157 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:47.275506 24157 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:47.276141 24157 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
I20260809 08:00:47.277328 23816 ts_manager.cc:194] Registered new tserver with Master: b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713)
I20260809 08:00:47.278082 23816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:43935
W20260809 08:00:47.377797 24160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:47.378028 24160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:47.378070 24160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:47.381879 24160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:47.381925 24160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:47.381978 24160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:00:47.386682 24160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:36143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=34835
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:47.387552 24160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:47.388420 24160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:47.397754 24165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:47.397794 24160 server_base.cc:1034] running on GCE node
W20260809 08:00:47.397859 24166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:47.397765 24168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:47.398360 24160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:47.398892 24160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:47.400044 24160 hybrid_clock.cc:648] HybridClock initialized: now 1786262447400028 us; error 29 us; skew 500 ppm
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262447, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:47.402606 24160 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:00:47.403352 24160 webserver.cc:460] Webserver started at http://127.8.51.67:34835/ using document root <none> and password file <none>
I20260809 08:00:47.403836 24160 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:47.403899 24160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:47.407280 24160 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:47.409164 24175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.410434 24160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:47.410564 24160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "b01f54c94fd04797b36af47d7ef87773"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "5e0c9d925efd60523f5f9b01b95309ec"
server_key_iv: "0245770de1a136902fb5463e6be79b83"
server_key_version: "encryptionkey@0"
I20260809 08:00:47.411180 24160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:47.423135 24160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:47.425873 24160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:47.426015 24160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:47.426498 24160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:47.427205 24160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:47.427249 24160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.427286 24160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:47.427306 24160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.436318 24160 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36143
I20260809 08:00:47.436348 24292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36143 every 8 connection(s)
I20260809 08:00:47.437274 24160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:00:47.441545 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24160
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262447, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:00:47.451608 24298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.442320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47992 (local address 127.8.51.126:38671)
0809 08:00:47.442584 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.442587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.442721 (+ 134us) server_negotiation.cc:407] Connection header received
0809 08:00:47.442855 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.442857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.442895 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.442970 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:47.443830 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.444461 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.445695 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.446265 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.446434 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.448055 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:47.448060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:47.448064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:47.448095 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:47.449927 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.450353 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.450357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.450359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.450452 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.450743 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.450746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.450748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.450967 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:47.451200 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.451285 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.451417 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":181,"server-negotiator.queue_time_us":189,"spinlock_wait_cycles":37888,"thread_start_us":80,"threads_started":1}
I20260809 08:00:47.453142 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.439226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:40527 (local address 127.8.51.126:38671)
0809 08:00:47.439369 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.439372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.440193 (+ 821us) server_negotiation.cc:407] Connection header received
0809 08:00:47.441710 (+ 1517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.441715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.441780 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.441857 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:47.443451 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.444080 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.445695 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.446265 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.446435 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.449379 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:47.449383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:47.449386 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:47.449412 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:47.450881 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.451474 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.451478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.451481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.451583 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:47.451976 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:47.451980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:47.451982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:47.452228 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:47.452316 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.452935 (+ 619us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.453033 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":194,"server-negotiator.queue_time_us":55,"spinlock_wait_cycles":3200}
I20260809 08:00:47.454190 24296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.439594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:40527)
0809 08:00:47.440048 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.440089 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.441429 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.442075 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.442082 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.442563 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:47.443290 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.443312 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.444228 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.444231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.445535 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.445548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.446427 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.446431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.446654 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.447169 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:47.447203 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:47.449202 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:47.450992 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.451001 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.451021 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.451353 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.451707 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:47.451710 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:47.451713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:47.451868 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:47.452330 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:47.452336 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:47.452656 (+ 320us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.452889 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.453239 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":123,"threads_started":1}
I20260809 08:00:47.455225 24293 heartbeater.cc:347] Connected to a master server at 127.8.51.126:38671
I20260809 08:00:47.455472 24293 heartbeater.cc:464] Registering TS with master...
I20260809 08:00:47.455953 24293 heartbeater.cc:511] Master 127.8.51.126:38671 requested a full tablet report, sending...
I20260809 08:00:47.456889 23816 ts_manager.cc:194] Registered new tserver with Master: b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
I20260809 08:00:47.457386 23816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:40527
I20260809 08:00:47.465415 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:00:47.469422 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.466138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47998 (local address 127.8.51.126:38671)
0809 08:00:47.466292 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.466295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.466435 (+ 140us) server_negotiation.cc:407] Connection header received
0809 08:00:47.466580 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.466582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.466675 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.466761 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:00:47.466944 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.467422 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.468227 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.468425 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.468498 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.468762 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:00:47.469138 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:00:47.469226 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.469279 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.469322 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 08:00:47.470089 23816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:00:47.473269 23816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:00:47.481675 23946 tablet_service.cc:1467] Processing CreateTablet for tablet 660dadb3f4f74343a6f0938abbd17116 (DEFAULT_TABLE table=test-table [id=ed73e5718f504dcc8f22ea5c521893a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:47.482363 23946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 660dadb3f4f74343a6f0938abbd17116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:47.485076 23900 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap starting.
I20260809 08:00:47.485520 24021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.480039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.0.0.1:40398)
0809 08:00:47.480178 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.480193 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.480273 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.481170 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.481176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.481198 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:47.481302 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.481308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.483129 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.483133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.483929 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.483937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.485060 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.485064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.485163 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.485214 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.485298 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.485382 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 08:00:47.486140 23900 tablet_bootstrap.cc:654] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:47.486500 24303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.480125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40398 (local address 127.8.51.66:36713)
0809 08:00:47.480610 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.480626 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.480661 (+ 35us) server_negotiation.cc:407] Connection header received
0809 08:00:47.480745 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.480751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.480994 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.481465 (+ 471us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:47.481670 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.482975 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.484076 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.484929 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.485045 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.485215 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.486213 (+ 998us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.486325 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":238,"threads_started":1}
I20260809 08:00:47.487675 23900 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: No bootstrap required, opened a new log
I20260809 08:00:47.487785 23900 ts_tablet_manager.cc:1397] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 08:00:47.488204 23900 raft_consensus.cc:348] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.488323 23900 raft_consensus.cc:374] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:47.488372 23900 raft_consensus.cc:729] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Initialized, Role: FOLLOWER
I20260809 08:00:47.488575 23900 consensus_queue.cc:260] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.489354 23900 ts_tablet_manager.cc:1428] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 08:00:47.489778 24089 tablet_service.cc:1467] Processing CreateTablet for tablet 660dadb3f4f74343a6f0938abbd17116 (DEFAULT_TABLE table=test-table [id=ed73e5718f504dcc8f22ea5c521893a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:47.491008 24089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 660dadb3f4f74343a6f0938abbd17116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:47.492311 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.481678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36143 (local address 127.0.0.1:41638)
0809 08:00:47.485374 (+ 3696us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.485389 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.485486 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.486078 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.486084 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.486109 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:47.486209 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.486216 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.488571 (+ 2355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.488574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.489878 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.489891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.491816 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.491820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.491955 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.491987 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.492059 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.492169 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3628,"thread_start_us":120,"threads_started":1}
I20260809 08:00:47.492347 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.481202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41638 (local address 127.8.51.67:36143)
0809 08:00:47.482254 (+ 1052us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.482267 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.485609 (+ 3342us) server_negotiation.cc:407] Connection header received
0809 08:00:47.485700 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.485705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.485924 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.486093 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:47.486363 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.488269 (+ 1906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.490019 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.491065 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.491173 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.491329 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.492108 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.492215 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":940,"thread_start_us":137,"threads_started":1}
I20260809 08:00:47.495041 24227 tablet_service.cc:1467] Processing CreateTablet for tablet 660dadb3f4f74343a6f0938abbd17116 (DEFAULT_TABLE table=test-table [id=ed73e5718f504dcc8f22ea5c521893a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:00:47.496012 24227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 660dadb3f4f74343a6f0938abbd17116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:00:47.498368 24307 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Bootstrap starting.
I20260809 08:00:47.501217 24307 tablet_bootstrap.cc:654] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:47.502163 24307 log.cc:824] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:47.504220 24309 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Bootstrap starting.
I20260809 08:00:47.504307 24307 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: No bootstrap required, opened a new log
I20260809 08:00:47.504551 24307 ts_tablet_manager.cc:1397] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 08:00:47.506671 24309 tablet_bootstrap.cc:654] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Neither blocks nor log segments found. Creating new log.
I20260809 08:00:47.507506 24309 log.cc:824] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:47.507937 24307 raft_consensus.cc:348] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.508199 24307 raft_consensus.cc:374] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:47.508284 24307 raft_consensus.cc:729] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ec8c50ac7c42dcbed89badb1ac5d71, State: Initialized, Role: FOLLOWER
I20260809 08:00:47.508760 24307 consensus_queue.cc:260] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.509420 24157 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
I20260809 08:00:47.509653 24309 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: No bootstrap required, opened a new log
I20260809 08:00:47.509825 24307 ts_tablet_manager.cc:1428] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 08:00:47.509843 24309 ts_tablet_manager.cc:1397] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:00:47.513042 24309 raft_consensus.cc:348] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.513278 24309 raft_consensus.cc:374] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:00:47.513353 24309 raft_consensus.cc:729] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01f54c94fd04797b36af47d7ef87773, State: Initialized, Role: FOLLOWER
I20260809 08:00:47.513854 24309 consensus_queue.cc:260] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.514499 24293 heartbeater.cc:503] Master 127.8.51.126:38671 was elected leader, sending a full tablet report...
I20260809 08:00:47.514887 24309 ts_tablet_manager.cc:1428] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 08:00:47.574692 24015 tablet.cc:2369] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:47.652493 24020 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:47.652757 24020 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.653919 24020 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
I20260809 08:00:47.658059 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.654787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:58725 (local address 127.8.51.67:36143)
0809 08:00:47.654925 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.654931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.654946 (+ 15us) server_negotiation.cc:407] Connection header received
0809 08:00:47.655091 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.655100 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.655149 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.655236 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:47.655467 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.655950 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657022 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.657410 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657526 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.657621 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.657852 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.657932 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:00:47.658064 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.654619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36143 (local address 127.8.51.65:58725)
0809 08:00:47.654880 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.654892 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.654971 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.655251 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.655254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.655270 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:47.655363 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.655368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.656066 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.656072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.656883 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.656910 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.657531 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.657693 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.657744 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.657837 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.657927 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":35,"thread_start_us":83,"threads_started":1}
I20260809 08:00:47.658064 24303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.654439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:59959 (local address 127.8.51.66:36713)
0809 08:00:47.654598 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.654602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.654623 (+ 21us) server_negotiation.cc:407] Connection header received
0809 08:00:47.654808 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.654814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.654873 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.654990 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:00:47.655277 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.655796 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657031 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.657412 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657527 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.657606 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.657853 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.657937 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:00:47.658077 24313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.654202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.8.51.65:59959)
0809 08:00:47.654452 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.654470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:47.654627 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:47.655015 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:47.655018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:47.655037 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:00:47.655153 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.655159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.655905 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.655911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.656880 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:47.656907 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.657534 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.657537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:47.657679 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.657743 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 08:00:47.657837 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 08:00:47.657949 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":53,"thread_start_us":92,"threads_started":1}
I20260809 08:00:47.658923 24247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "660dadb3f4f74343a6f0938abbd17116" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01f54c94fd04797b36af47d7ef87773" is_pre_election: true
I20260809 08:00:47.658921 24109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "660dadb3f4f74343a6f0938abbd17116" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" is_pre_election: true
I20260809 08:00:47.659240 24109 raft_consensus.cc:2454] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 0.
I20260809 08:00:47.659240 24247 raft_consensus.cc:2454] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 0.
I20260809 08:00:47.659689 23896 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570, b4ec8c50ac7c42dcbed89badb1ac5d71; no voters:
I20260809 08:00:47.659925 24020 raft_consensus.cc:2781] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:00:47.660019 24020 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:00:47.660077 24020 raft_consensus.cc:3037] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:47.661111 24020 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.661445 24020 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 election: Requested vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
I20260809 08:00:47.661829 24109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "660dadb3f4f74343a6f0938abbd17116" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
I20260809 08:00:47.661923 24247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "660dadb3f4f74343a6f0938abbd17116" candidate_uuid: "19e2275590e84dee8d832aaf9ca3b570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01f54c94fd04797b36af47d7ef87773"
I20260809 08:00:47.661971 24109 raft_consensus.cc:3037] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:47.662073 24247 raft_consensus.cc:3037] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:00:47.663036 24109 raft_consensus.cc:2454] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 1.
I20260809 08:00:47.663120 24247 raft_consensus.cc:2454] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e2275590e84dee8d832aaf9ca3b570 in term 1.
I20260809 08:00:47.663350 23896 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570, b4ec8c50ac7c42dcbed89badb1ac5d71; no voters:
I20260809 08:00:47.663548 24020 raft_consensus.cc:2781] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:00:47.663748 24020 raft_consensus.cc:686] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 LEADER]: Becoming Leader. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Running, Role: LEADER
I20260809 08:00:47.664005 24020 consensus_queue.cc:237] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:47.666900 23816 catalog_manager.cc:5495] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "19e2275590e84dee8d832aaf9ca3b570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } health_report { overall_health: HEALTHY } } }
I20260809 08:00:47.679345 24317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.675531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.8.51.65:40609)
0809 08:00:47.675863 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:47.675870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:47.675881 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:00:47.675944 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:47.675946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:47.675996 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:47.676126 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:00:47.676380 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.676919 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.677844 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:47.678078 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:47.678192 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:47.678485 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:00:47.678919 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:00:47.679049 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:47.679113 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 08:00:47.679166 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":132,"threads_started":1}
I20260809 08:00:47.683269 24109 raft_consensus.cc:1261] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Refusing update from remote peer 19e2275590e84dee8d832aaf9ca3b570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:47.683287 24247 raft_consensus.cc:1261] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Refusing update from remote peer 19e2275590e84dee8d832aaf9ca3b570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:00:47.683995 24020 consensus_queue.cc:1035] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:00:47.684216 24315 consensus_queue.cc:1035] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 08:00:47.688331 24295 tablet.cc:2369] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:00:47.699349 23816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:47.699483 23816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:00:47.701664 23816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Sending DeleteTablet for 3 replicas of tablet 660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:47.702391 23946 tablet_service.cc:1514] Processing DeleteTablet for tablet 660dadb3f4f74343a6f0938abbd17116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:47 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:50050
I20260809 08:00:47.702373 24089 tablet_service.cc:1514] Processing DeleteTablet for tablet 660dadb3f4f74343a6f0938abbd17116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:47 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:40398
I20260809 08:00:47.702591 24227 tablet_service.cc:1514] Processing DeleteTablet for tablet 660dadb3f4f74343a6f0938abbd17116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:00:47 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:41638
I20260809 08:00:47.702845 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23855
I20260809 08:00:47.702983 24331 tablet_replica.cc:330] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: stopping tablet replica
I20260809 08:00:47.703891 24331 raft_consensus.cc:2229] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:47.704170 24331 raft_consensus.cc:2258] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:47.706070 24330 tablet_replica.cc:330] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: stopping tablet replica
I20260809 08:00:47.706411 24330 raft_consensus.cc:2229] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:00:47.706444 24331 ts_tablet_manager.cc:1905] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:47.706725 24330 raft_consensus.cc:2258] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:00:47.708094 24330 ts_tablet_manager.cc:1905] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:00:47.708768 24331 ts_tablet_manager.cc:1918] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:47.708889 24331 log.cc:1196] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:47.709231 24331 ts_tablet_manager.cc:1939] T 660dadb3f4f74343a6f0938abbd17116 P b01f54c94fd04797b36af47d7ef87773: Deleting consensus metadata
I20260809 08:00:47.710332 23802 catalog_manager.cc:4841] TS b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): tablet 660dadb3f4f74343a6f0938abbd17116 (table test-table [id=ed73e5718f504dcc8f22ea5c521893a1]) successfully deleted
I20260809 08:00:47.711555 24330 ts_tablet_manager.cc:1918] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:00:47.711665 24330 log.cc:1196] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:47.711982 24330 ts_tablet_manager.cc:1939] T 660dadb3f4f74343a6f0938abbd17116 P b4ec8c50ac7c42dcbed89badb1ac5d71: Deleting consensus metadata
I20260809 08:00:47.712664 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24016
W20260809 08:00:47.712653 23801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:40609 (error 108)
I20260809 08:00:47.714965 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.714654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:40609 (local address 127.0.0.1:50080)
0809 08:00:47.714783 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.714880 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:40609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 08:00:47.715216 23801 catalog_manager.cc:4584] TS 19e2275590e84dee8d832aaf9ca3b570 (127.8.51.65:40609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 660dadb3f4f74343a6f0938abbd17116: Network error: Client connection negotiation failed: client connection to 127.8.51.65:40609: connect: Connection refused (error 111)
I20260809 08:00:47.719548 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24160
I20260809 08:00:47.721534 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:47.719645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.0.0.1:40406)
0809 08:00:47.721399 (+ 1754us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:47.721454 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.66:36713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1659}
I20260809 08:00:47.726215 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 23782
I20260809 08:00:47.733758 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--webserver_interface=127.8.51.126
--webserver_port=46495
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:38671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:47.841431 24333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:47.841717 24333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:47.841786 24333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:47.845628 24333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:00:47.845701 24333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:47.845739 24333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:47.845795 24333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:00:47.845834 24333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:00:47.850802 24333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:38671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=46495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:47.851730 24333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:47.852662 24333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:47.860580 24338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:47.860728 24339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:47.860620 24341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:47.860669 24333 server_base.cc:1034] running on GCE node
I20260809 08:00:47.861434 24333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:47.862455 24333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:47.863642 24333 hybrid_clock.cc:648] HybridClock initialized: now 1786262447863632 us; error 27 us; skew 500 ppm
Aug 09 08:00:47 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262447, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:47.866405 24333 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:00:47.867286 24333 webserver.cc:460] Webserver started at http://127.8.51.126:46495/ using document root <none> and password file <none>
I20260809 08:00:47.867779 24333 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:47.867836 24333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:47.871354 24333 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:00:47.873329 24348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:47.874605 24333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:47.874701 24333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c7890119248a48e09d554419104f0e5f"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "53aa2519cfe254e2da7d6a2f21cef386"
server_key_iv: "b474a37965bb898443036ccf8c4f69ed"
server_key_version: "encryptionkey@0"
I20260809 08:00:47.875176 24333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:47.901335 24333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:47.904498 24333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:47.904645 24333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:47.911234 24333 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:38671
I20260809 08:00:47.911523 24406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:38671 every 8 connection(s)
I20260809 08:00:47.912238 24333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:00:47.916220 24407 sys_catalog.cc:263] Verifying existing consensus state
I20260809 08:00:47.917789 24407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap starting.
I20260809 08:00:47.919688 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24333
I20260809 08:00:47.920177 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:40609
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=42701
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:47.940907 24407 log.cc:824] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:47.955400 24407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:00:47.955837 24407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f: Bootstrap complete.
I20260809 08:00:47.961201 24407 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:47.961717 24407 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7890119248a48e09d554419104f0e5f, State: Initialized, Role: FOLLOWER
I20260809 08:00:47.962255 24407 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:47.962402 24407 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:00:47.962476 24407 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:00:47.962572 24407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 2 FOLLOWER]: Advancing to term 3
I20260809 08:00:47.965076 24407 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:47.965417 24407 leader_election.cc:302] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7890119248a48e09d554419104f0e5f; no voters:
I20260809 08:00:47.965762 24407 leader_election.cc:288] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 08:00:47.965886 24411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260809 08:00:47.966138 24411 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [term 3 LEADER]: Becoming Leader. State: Replica: c7890119248a48e09d554419104f0e5f, State: Running, Role: LEADER
I20260809 08:00:47.966437 24411 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } }
I20260809 08:00:47.966956 24407 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:00:47.967960 24413 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7890119248a48e09d554419104f0e5f. Latest consensus state: current_term: 3 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:47.968102 24413 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:47.967960 24412 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c7890119248a48e09d554419104f0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7890119248a48e09d554419104f0e5f" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 38671 } } }
I20260809 08:00:47.968207 24412 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7890119248a48e09d554419104f0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:00:47.968477 24420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:00:47.973819 24420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:00:47.974599 24420 catalog_manager.cc:1259] Loaded cluster ID: cf749197bed94eea90b9da73484a5b54
I20260809 08:00:47.974677 24420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 08:00:47.975549 24420 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f94da04b9ad google::LogMessage::Fail() at ??:0
@ 0x7f94da04e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f94da04b4de google::LogMessage::Flush() at ??:0
@ 0x7f94da04ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f94e498efdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f94e498fd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f94e498c579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f94e49d0640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f94dc29d3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f94dc29dc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f94dc29f3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f94dc28e512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f94dd8d26db start_thread at ??:0
@ 0x7f94d8b4961f clone at ??:0
W20260809 08:00:48.059958 24409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:48.060225 24409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:48.060326 24409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:48.064043 24409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:48.064122 24409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:48.064220 24409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:00:48.069281 24409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:40609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=42701
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:48.070338 24409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:48.071296 24409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:48.081429 24449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.081408 24450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.081485 24454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:48.081902 24409 server_base.cc:1034] running on GCE node
I20260809 08:00:48.082293 24409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:48.082867 24409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:48.084051 24409 hybrid_clock.cc:648] HybridClock initialized: now 1786262448084030 us; error 45 us; skew 500 ppm
Aug 09 08:00:48 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262448, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:48.086790 24409 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:00:48.087716 24409 webserver.cc:460] Webserver started at http://127.8.51.65:42701/ using document root <none> and password file <none>
I20260809 08:00:48.088243 24409 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:48.088333 24409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:48.091979 24409 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:48.094007 24461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.095263 24409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:48.095347 24409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "19e2275590e84dee8d832aaf9ca3b570"
format_stamp: "Formatted at 2026-08-09 08:00:45 on dist-test-slave-njxd"
server_key: "20d697a1fce5860ee365894c2b600bdb"
server_key_iv: "2168c1fdd356aed0803ee84e20762409"
server_key_version: "encryptionkey@0"
I20260809 08:00:48.095945 24409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:48.108129 24409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:48.111079 24409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:48.111258 24409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:48.111775 24409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:48.112797 24468 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 08:00:48.118075 24409 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 08:00:48.118144 24409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260809 08:00:48.118211 24409 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 08:00:48.119779 24409 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 08:00:48.119848 24409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 08:00:48.120139 24468 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap starting.
I20260809 08:00:48.130127 24409 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:40609
I20260809 08:00:48.130985 24409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:00:48.131538 24581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:40609 every 8 connection(s)
I20260809 08:00:48.138440 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24409
I20260809 08:00:48.138863 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:36713
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=34351
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:00:48.143813 24468 log.cc:824] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Log is configured to *not* fsync() on all Append() calls
I20260809 08:00:48.150468 24468 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:00:48.150825 24468 tablet_bootstrap.cc:492] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Bootstrap complete.
I20260809 08:00:48.151870 24468 ts_tablet_manager.cc:1397] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Time spent bootstrapping tablet: real 0.032s user 0.024s sys 0.003s
I20260809 08:00:48.154170 24468 raft_consensus.cc:348] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:48.154573 24468 raft_consensus.cc:729] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e2275590e84dee8d832aaf9ca3b570, State: Initialized, Role: FOLLOWER
I20260809 08:00:48.155041 24468 consensus_queue.cc:260] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:48.155917 24468 ts_tablet_manager.cc:1428] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
W20260809 08:00:48.223608 24585 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:00:48.132908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:58539)
0809 08:00:48.133376 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.133426 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:48.134205 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:48.222858 (+ 88653us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":151,"threads_started":1}
W20260809 08:00:48.224328 24583 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38671 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:38671: Client connection negotiation failed: client connection to 127.8.51.126:38671: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 08:00:48.225143 24585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.224899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:45301)
0809 08:00:48.225024 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.225091 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 08:00:48.225873 24585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.225689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:51987)
0809 08:00:48.225785 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.225826 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 08:00:48.226039 24583 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 08:00:48.275147 24586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:48.275434 24586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:48.275514 24586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:48.279489 24586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:48.279544 24586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:48.279600 24586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:00:48.284456 24586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:36713
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=34351
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:48.285372 24586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:48.286369 24586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:48.295816 24596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.295822 24594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.295817 24593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:48.296099 24586 server_base.cc:1034] running on GCE node
I20260809 08:00:48.296561 24586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:48.297163 24586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:48.298343 24586 hybrid_clock.cc:648] HybridClock initialized: now 1786262448298331 us; error 25 us; skew 500 ppm
Aug 09 08:00:48 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262448, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:48.301159 24586 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:00:48.302040 24586 webserver.cc:460] Webserver started at http://127.8.51.66:34351/ using document root <none> and password file <none>
I20260809 08:00:48.302584 24586 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:48.302685 24586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:48.306639 24586 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:00:48.308542 24603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.309824 24586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:48.309958 24586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "9f88411fbf9931333543c09ef5c41c98"
server_key_iv: "dbd69cefd00bc0c00da36a3f14c616d9"
server_key_version: "encryptionkey@0"
I20260809 08:00:48.310490 24586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:48.324638 24586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:48.327685 24586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:48.327900 24586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:48.328512 24586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:48.329365 24586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:48.329437 24586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.329511 24586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:48.329561 24586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.338246 24586 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:36713
I20260809 08:00:48.338289 24722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:36713 every 8 connection(s)
I20260809 08:00:48.339262 24586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:00:48.343129 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.341366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:48603)
0809 08:00:48.342357 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.342463 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":591,"threads_started":1}
W20260809 08:00:48.343613 24723 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38671 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:38671: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
I20260809 08:00:48.344172 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.343983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:53505)
0809 08:00:48.344077 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.344121 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 08:00:48.344762 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.344591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:44349)
0809 08:00:48.344678 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.344716 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 08:00:48.344954 24723 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 08:00:48.346827 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24586
I20260809 08:00:48.347249 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:36143
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:38671
--webserver_port=34835
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:00:48.456496 24726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:00:48.456815 24726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:00:48.456909 24726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:00:48.461086 24726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:00:48.461198 24726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:00:48.461295 24726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:00:48.466573 24726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:36143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=34835
--tserver_master_addrs=127.8.51.126:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:00:48.467703 24726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:00:48.468833 24726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:00:48.478392 24732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.478395 24731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:00:48.478397 24734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:00:48.478646 24726 server_base.cc:1034] running on GCE node
I20260809 08:00:48.479079 24726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:00:48.479688 24726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:00:48.480851 24726 hybrid_clock.cc:648] HybridClock initialized: now 1786262448480836 us; error 27 us; skew 500 ppm
Aug 09 08:00:48 dist-test-slave-njxd krb5kdc[23202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262448, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:00:48.483920 24726 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:00:48.484903 24726 webserver.cc:460] Webserver started at http://127.8.51.67:34835/ using document root <none> and password file <none>
I20260809 08:00:48.485616 24726 fs_manager.cc:359] Metadata directory not provided
I20260809 08:00:48.485709 24726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:00:48.489547 24726 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:00:48.491575 24741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.492946 24726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:00:48.493039 24726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "b01f54c94fd04797b36af47d7ef87773"
format_stamp: "Formatted at 2026-08-09 08:00:46 on dist-test-slave-njxd"
server_key: "5e0c9d925efd60523f5f9b01b95309ec"
server_key_iv: "0245770de1a136902fb5463e6be79b83"
server_key_version: "encryptionkey@0"
I20260809 08:00:48.493552 24726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:00:48.506338 24726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:00:48.509553 24726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:00:48.509771 24726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:00:48.510315 24726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:00:48.511085 24726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:00:48.511137 24726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.511176 24726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:00:48.511197 24726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:00:48.520469 24726 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:36143
I20260809 08:00:48.520504 24864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:36143 every 8 connection(s)
I20260809 08:00:48.521431 24726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:00:48.524580 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24726
I20260809 08:00:48.525540 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.523491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:49889)
0809 08:00:48.523946 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.524051 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":128,"threads_started":1}
W20260809 08:00:48.526080 24865 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:38671 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:38671: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
I20260809 08:00:48.526640 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.526442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:34619)
0809 08:00:48.526544 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.526586 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 08:00:48.527180 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:48.526994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:41669)
0809 08:00:48.527085 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:48.527124 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 08:00:48.527341 24865 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 08:00:49.227135 24869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.226672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:34257)
0809 08:00:49.226935 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:49.226996 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":77,"threads_started":1}
I20260809 08:00:49.345988 24870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.345510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:55993)
0809 08:00:49.345843 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:49.345895 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":115,"threads_started":1}
I20260809 08:00:49.528430 24871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.528060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:59733)
0809 08:00:49.528287 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:49.528339 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":70,"threads_started":1}
I20260809 08:00:49.974453 24872 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:49.974674 24872 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:49.975828 24872 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
Aug 09 08:00:49 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262448, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.67@KRBTEST.COM
Aug 09 08:00:49 dist-test-slave-njxd krb5kdc[23202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262448, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.66@KRBTEST.COM
I20260809 08:00:49.988808 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.976435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:36143 (local address 127.8.51.65:37847)
0809 08:00:49.976672 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:49.976696 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:49.976779 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:49.978374 (+ 1595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:49.978377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:49.978673 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:49.979120 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:49.979134 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.980396 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.980400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:49.981323 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:49.981331 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.982033 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.982036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:49.982282 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:49.982967 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:49.982983 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:49.984796 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:49.986720 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:49.986725 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:49.986753 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:49.986972 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:49.987302 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987304 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:49.987306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:49.987426 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:49.987962 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:49.987967 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:49.988154 (+ 187us) client_negotiation.cc:769] Sending connection context
0809 08:00:49.988311 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 08:00:49.988590 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":141,"spinlock_wait_cycles":5120,"thread_start_us":58,"threads_started":1}
I20260809 08:00:49.988818 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.976778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:37847 (local address 127.8.51.67:36143)
0809 08:00:49.977111 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:49.977128 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:49.977170 (+ 42us) server_negotiation.cc:407] Connection header received
0809 08:00:49.977867 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:49.977873 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:49.978164 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:49.978445 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:49.979289 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.980248 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.981446 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.981918 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.982080 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:49.985002 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:49.985007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:49.985018 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:49.985041 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:49.986607 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987086 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:49.987091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:49.987096 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:49.987203 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987513 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:49.987517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:49.987519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:49.987851 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:49.987971 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:49.988410 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 08:00:49.988645 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":107,"threads_started":1}
I20260809 08:00:49.989033 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.976230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:51711 (local address 127.8.51.66:36713)
0809 08:00:49.976595 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0809 08:00:49.976612 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:00:49.976659 (+ 47us) server_negotiation.cc:407] Connection header received
0809 08:00:49.977385 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:00:49.977391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:00:49.977807 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:00:49.978110 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:00:49.979296 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.980246 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.981441 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.981919 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.982080 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:49.985304 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:00:49.985312 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:00:49.985326 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:00:49.985358 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:00:49.987007 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987424 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:49.987429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:49.987433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:49.987552 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987805 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:00:49.987808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:00:49.987810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:00:49.988126 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:00:49.988246 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 08:00:49.988531 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 08:00:49.988843 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":118,"threads_started":1}
I20260809 08:00:49.988886 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:49.976016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:36713 (local address 127.8.51.65:51711)
0809 08:00:49.976291 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:49.976303 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:00:49.976440 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:00:49.978157 (+ 1717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:00:49.978162 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:00:49.978662 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:00:49.979119 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:49.979132 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.980387 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.980391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:49.981325 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:00:49.981334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:00:49.982037 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:00:49.982040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:00:49.982283 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:00:49.982916 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:00:49.982953 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:00:49.985109 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:00:49.987117 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987123 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:49.987125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:49.987314 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:49.987645 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:00:49.987648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:00:49.987649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:00:49.987723 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:00:49.988230 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:00:49.988233 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:00:49.988316 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 08:00:49.988417 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 08:00:49.988683 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":333,"spinlock_wait_cycles":25728,"thread_start_us":102,"threads_started":1}
W20260809 08:00:49.991494 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
W20260809 08:00:49.991638 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:49.991685 24464 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570; no voters: b01f54c94fd04797b36af47d7ef87773, b4ec8c50ac7c42dcbed89badb1ac5d71
I20260809 08:00:49.991853 24872 raft_consensus.cc:2726] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:00:50.228397 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:50.228008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:38549)
0809 08:00:50.228237 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:50.228312 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260809 08:00:50.347199 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:50.346768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:58183)
0809 08:00:50.347022 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:50.347079 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":86,"threads_started":1}
I20260809 08:00:50.529637 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:50.529123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:40049)
0809 08:00:50.529429 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:50.529488 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":92,"threads_started":1}
I20260809 08:00:51.229859 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:51.229370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:56351)
0809 08:00:51.229664 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:51.229733 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":87,"threads_started":1}
I20260809 08:00:51.348356 24881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:51.347944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:36323)
0809 08:00:51.348197 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:51.348246 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":95,"threads_started":1}
I20260809 08:00:51.530838 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:51.530410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:51161)
0809 08:00:51.530681 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:51.530749 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":75,"threads_started":1}
I20260809 08:00:52.147941 24883 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:52.148067 24883 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:52.148418 24883 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
W20260809 08:00:52.149282 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
W20260809 08:00:52.149441 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:52.149507 24464 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570; no voters: b01f54c94fd04797b36af47d7ef87773, b4ec8c50ac7c42dcbed89badb1ac5d71
I20260809 08:00:52.149705 24883 raft_consensus.cc:2726] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:00:52.231038 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:52.230645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:37533)
0809 08:00:52.230889 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:52.230943 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260809 08:00:52.349648 24885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:52.349140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:46543)
0809 08:00:52.349480 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:52.349535 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":127,"threads_started":1}
I20260809 08:00:52.531931 24886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:52.531556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:35965)
0809 08:00:52.531787 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:52.531840 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":75,"threads_started":1}
I20260809 08:00:53.232427 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:53.231985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:53191)
0809 08:00:53.232281 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:53.232335 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":72,"threads_started":1}
I20260809 08:00:53.350833 24888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:53.350404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:59537)
0809 08:00:53.350668 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:53.350732 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":91,"threads_started":1}
I20260809 08:00:53.533260 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:53.532767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:38189)
0809 08:00:53.533101 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:53.533158 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":91,"threads_started":1}
I20260809 08:00:54.233649 24890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:54.233182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:47273)
0809 08:00:54.233441 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:54.233493 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":93,"threads_started":1}
I20260809 08:00:54.351924 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:54.351531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:56209)
0809 08:00:54.351782 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:54.351835 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":96,"threads_started":1}
I20260809 08:00:54.534541 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:54.534121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:38239)
0809 08:00:54.534380 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:54.534435 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
I20260809 08:00:54.862718 24893 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:54.862879 24893 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:54.863329 24893 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
W20260809 08:00:54.864138 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
W20260809 08:00:54.864297 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:54.864352 24464 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570; no voters: b01f54c94fd04797b36af47d7ef87773, b4ec8c50ac7c42dcbed89badb1ac5d71
I20260809 08:00:54.864513 24893 raft_consensus.cc:2726] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:00:55.234835 24894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:55.234414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:47481)
0809 08:00:55.234685 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:55.234740 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":74,"threads_started":1}
I20260809 08:00:55.353159 24895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:55.352671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:44829)
0809 08:00:55.352981 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:55.353045 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":85,"threads_started":1}
I20260809 08:00:55.535691 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:55.535270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:54603)
0809 08:00:55.535543 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:55.535598 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":72,"threads_started":1}
I20260809 08:00:56.235991 24897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:56.235589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:51547)
0809 08:00:56.235843 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:56.235898 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":78,"threads_started":1}
I20260809 08:00:56.354462 24898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:56.354028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:42523)
0809 08:00:56.354293 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:56.354348 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260809 08:00:56.536885 24899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:56.536477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:48363)
0809 08:00:56.536733 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:56.536790 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
I20260809 08:00:57.237341 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:57.236920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:40005)
0809 08:00:57.237188 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:57.237247 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":79,"threads_started":1}
I20260809 08:00:57.355593 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:57.355186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:50629)
0809 08:00:57.355446 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:57.355501 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260809 08:00:57.538064 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:57.537658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:54257)
0809 08:00:57.537913 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:57.537968 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":75,"threads_started":1}
I20260809 08:00:58.238719 24905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:58.238261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:49069)
0809 08:00:58.238550 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:58.238610 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":79,"threads_started":1}
I20260809 08:00:58.356850 24906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:58.356330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:60391)
0809 08:00:58.356689 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:58.356751 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":77,"threads_started":1}
I20260809 08:00:58.539232 24907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:58.538839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:49715)
0809 08:00:58.539087 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:58.539139 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260809 08:00:59.024314 24908 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:00:59.024451 24908 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:00:59.024807 24908 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
W20260809 08:00:59.025655 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
W20260809 08:00:59.025837 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
I20260809 08:00:59.025904 24464 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570; no voters: b01f54c94fd04797b36af47d7ef87773, b4ec8c50ac7c42dcbed89badb1ac5d71
I20260809 08:00:59.026085 24908 raft_consensus.cc:2726] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:00:59.239919 24909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:59.239432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:47919)
0809 08:00:59.239769 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:59.239826 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":75,"threads_started":1}
I20260809 08:00:59.358050 24911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:59.357622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:58163)
0809 08:00:59.357878 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:59.357952 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":70,"threads_started":1}
I20260809 08:00:59.540482 24912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:00:59.540016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:52615)
0809 08:00:59.540330 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 08:00:59.540389 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":111,"threads_started":1}
I20260809 08:01:00.241168 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:00.240741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:44001)
0809 08:01:00.241015 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:00.241073 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":74,"threads_started":1}
I20260809 08:01:00.359200 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:00.358791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:33107)
0809 08:01:00.359043 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:00.359103 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
I20260809 08:01:00.541704 24915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:00.541247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:57879)
0809 08:01:00.541491 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:00.541547 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260809 08:01:01.242381 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:01.242003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:37479)
0809 08:01:01.242234 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:01.242286 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":73,"threads_started":1}
I20260809 08:01:01.360469 24917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:01.360066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:47691)
0809 08:01:01.360305 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:01.360376 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
I20260809 08:01:01.542743 24918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:01.542372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:44105)
0809 08:01:01.542592 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:01.542652 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260809 08:01:01.936501 24919 raft_consensus.cc:482] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:01.936645 24919 raft_consensus.cc:504] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ec8c50ac7c42dcbed89badb1ac5d71" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 36713 } } peers { permanent_uuid: "b01f54c94fd04797b36af47d7ef87773" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 36143 } } peers { permanent_uuid: "19e2275590e84dee8d832aaf9ca3b570" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 40609 } }
I20260809 08:01:01.937111 24919 leader_election.cc:288] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713), b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143)
W20260809 08:01:01.938024 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4ec8c50ac7c42dcbed89badb1ac5d71 (127.8.51.66:36713): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
W20260809 08:01:01.938181 24464 leader_election.cc:341] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b01f54c94fd04797b36af47d7ef87773 (127.8.51.67:36143): Not found: Tablet not found: 660dadb3f4f74343a6f0938abbd17116
I20260809 08:01:01.938256 24464 leader_election.cc:302] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19e2275590e84dee8d832aaf9ca3b570; no voters: b01f54c94fd04797b36af47d7ef87773, b4ec8c50ac7c42dcbed89badb1ac5d71
I20260809 08:01:01.938426 24919 raft_consensus.cc:2726] T 660dadb3f4f74343a6f0938abbd17116 P 19e2275590e84dee8d832aaf9ca3b570 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:01:02.243561 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:02.243175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:59105)
0809 08:01:02.243413 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:02.243467 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":78,"threads_started":1}
I20260809 08:01:02.361737 24921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:02.361190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:56403)
0809 08:01:02.361517 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:02.361623 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":79,"threads_started":1}
I20260809 08:01:02.543929 24922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:02.543527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.67:33073)
0809 08:01:02.543779 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:02.543835 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":76,"threads_started":1}
I20260809 08:01:03.245044 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:03.244662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.65:46807)
0809 08:01:03.244887 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:03.244936 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
I20260809 08:01:03.362996 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:03.362610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:38671 (local address 127.8.51.66:42611)
0809 08:01:03.362851 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:03.362903 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:38671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
I20260809 08:01:03.530746 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24409
I20260809 08:01:03.538735 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24586
I20260809 08:01:03.544731 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24726
2026-08-09T08:01:03Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19250 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:01:03 dist-test-slave-njxd krb5kdc[24927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:01:03 dist-test-slave-njxd krb5kdc[24927](info): set up 2 sockets
Aug 09 08:01:03 dist-test-slave-njxd krb5kdc[24927](info): commencing operation
krb5kdc: starting...
W20260809 08:01:04.585656 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:01:04 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:01:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:01:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:01:04.708734 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:35581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:04.831734 24940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:04.831998 24940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:04.832038 24940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:04.835978 24940 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 08:01:04.836023 24940 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 08:01:04.836038 24940 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 08:01:04.836051 24940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:01:04.836069 24940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:04.836086 24940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:04.836120 24940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:01:04.836154 24940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:01:04.841147 24940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:35581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:04.842161 24940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:04.843115 24940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:01:04.851768 24940 server_base.cc:1034] running on GCE node
W20260809 08:01:04.851715 24949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:04.851713 24947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:04.851717 24946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:04.852640 24940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:04.853801 24940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:04.854980 24940 hybrid_clock.cc:648] HybridClock initialized: now 1786262464854973 us; error 27 us; skew 500 ppm
Aug 09 08:01:04 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262464, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:04.857684 24940 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:01:04.858494 24940 webserver.cc:460] Webserver started at http://127.8.51.126:42905/ using document root <none> and password file <none>
I20260809 08:01:04.859040 24940 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:04.859127 24940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:04.859364 24940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:01:04.861346 24940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "2509bf38bacd4a178d12febcf628880a"
format_stamp: "Formatted at 2026-08-09 08:01:04 on dist-test-slave-njxd"
server_key: "7a4f55fa250ce491f5a4c94501a7365e"
server_key_iv: "7f09be27c635082d9436d1f925b13604"
server_key_version: "encryptionkey@0"
I20260809 08:01:04.861934 24940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "2509bf38bacd4a178d12febcf628880a"
format_stamp: "Formatted at 2026-08-09 08:01:04 on dist-test-slave-njxd"
server_key: "7a4f55fa250ce491f5a4c94501a7365e"
server_key_iv: "7f09be27c635082d9436d1f925b13604"
server_key_version: "encryptionkey@0"
I20260809 08:01:04.865393 24940 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:01:04.867722 24956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:04.868842 24940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:04.868978 24940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "2509bf38bacd4a178d12febcf628880a"
format_stamp: "Formatted at 2026-08-09 08:01:04 on dist-test-slave-njxd"
server_key: "7a4f55fa250ce491f5a4c94501a7365e"
server_key_iv: "7f09be27c635082d9436d1f925b13604"
server_key_version: "encryptionkey@0"
I20260809 08:01:04.869083 24940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:04.888639 24940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:04.892095 24940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:04.892335 24940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:04.899569 24940 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:35581
I20260809 08:01:04.899868 25011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:35581 every 8 connection(s)
I20260809 08:01:04.900599 24940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:01:04.903352 25012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:04.904456 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 24940
I20260809 08:01:04.904572 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:01:04.904897 8397 external_mini_cluster.cc:1428] Setting key 50657fd00f26cebbdf8ee36f2b8d1c74
I20260809 08:01:04.909988 25012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap starting.
I20260809 08:01:04.912092 25012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:04.912820 25012 log.cc:824] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Log is configured to *not* fsync() on all Append() calls
Aug 09 08:01:04 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:04.915072 25012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: No bootstrap required, opened a new log
I20260809 08:01:04.919342 25012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:04.919596 25012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:04.919694 25012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Initialized, Role: FOLLOWER
I20260809 08:01:04.919763 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:04.906297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35166 (local address 127.8.51.126:35581)
0809 08:01:04.906713 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:04.906738 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:04.906773 (+ 35us) server_negotiation.cc:407] Connection header received
0809 08:01:04.907449 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:04.907475 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:04.907852 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:04.908117 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:04.909020 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:04.910075 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:04.910962 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:04.911432 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:04.911597 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:04.914330 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:04.914339 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:04.914359 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:04.914397 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:04.916680 (+ 2283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:04.917307 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:04.917312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:04.917317 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:04.917430 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:04.917769 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:04.917772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:04.917773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:04.918163 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:04.918321 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:04.918614 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 08:01:04.918936 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":153,"threads_started":1}
I20260809 08:01:04.920225 25012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:04.920394 25012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:01:04.920460 25012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:01:04.920553 25012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:04.921555 25012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:04.921989 25012 leader_election.cc:302] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2509bf38bacd4a178d12febcf628880a; no voters:
I20260809 08:01:04.922333 25012 leader_election.cc:288] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:01:04.922423 25017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:01:04.922679 25017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 LEADER]: Becoming Leader. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Running, Role: LEADER
I20260809 08:01:04.923020 25017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:04.923659 25012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:01:04.924902 25018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:04.925194 25019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2509bf38bacd4a178d12febcf628880a. Latest consensus state: current_term: 1 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:04.925303 25018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:04.925410 25019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:04.926275 25028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:01:04.928936 25028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:01:04.934507 25028 catalog_manager.cc:1347] Generated new cluster ID: 52a91f27e2c44a2abde855493da6e213
I20260809 08:01:04.934610 25028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:01:04.952775 25028 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:01:04.953888 25028 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:01:04.961076 25028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Generated new TSK 0
I20260809 08:01:04.961983 25028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:01:04.993211 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:05.108538 25038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:05.108829 25038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:05.108923 25038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:05.112854 25038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:05.112946 25038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:05.113037 25038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:01:05.118875 25038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:05.119971 25038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:05.121039 25038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:05.130843 25044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:05.130930 25038 server_base.cc:1034] running on GCE node
W20260809 08:01:05.130925 25045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:05.130842 25047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:05.131551 25038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:05.132196 25038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:05.133383 25038 hybrid_clock.cc:648] HybridClock initialized: now 1786262465133348 us; error 46 us; skew 500 ppm
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:05.136175 25038 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:01:05.137009 25038 webserver.cc:460] Webserver started at http://127.8.51.65:43797/ using document root <none> and password file <none>
I20260809 08:01:05.137564 25038 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:05.137702 25038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:05.137936 25038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:01:05.140030 25038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "f833fb1e31e24d6797480ce9edeb34a0"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "9eba4b910de07de1af643ca6ce1937bf"
server_key_iv: "cc313516a50e25860e88669cb87d344f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.140637 25038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "f833fb1e31e24d6797480ce9edeb34a0"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "9eba4b910de07de1af643ca6ce1937bf"
server_key_iv: "cc313516a50e25860e88669cb87d344f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.144416 25038 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 08:01:05.147118 25054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.148473 25038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 08:01:05.148623 25038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "f833fb1e31e24d6797480ce9edeb34a0"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "9eba4b910de07de1af643ca6ce1937bf"
server_key_iv: "cc313516a50e25860e88669cb87d344f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.148756 25038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:05.164894 25038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:05.167860 25038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:05.168051 25038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:05.168658 25038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:05.169448 25038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:05.169516 25038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.169612 25038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:05.169670 25038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.178485 25038 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:34847
I20260809 08:01:05.178553 25170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:34847 every 8 connection(s)
I20260809 08:01:05.179347 25038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:01:05.180848 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25038
I20260809 08:01:05.180974 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:01:05.181332 8397 external_mini_cluster.cc:1428] Setting key b49061bb27ca57cb854e168ce4331d95
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:01:05.193109 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.181306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:49573 (local address 127.8.51.126:35581)
0809 08:01:05.181453 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.181457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.182659 (+ 1202us) server_negotiation.cc:407] Connection header received
0809 08:01:05.183624 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.183630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.183687 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.183778 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:05.184878 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.185409 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.186709 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.186934 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.187035 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.189484 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:05.189488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:05.189490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:05.189519 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:05.191199 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.191681 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.191688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.191692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.191796 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.192165 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.192168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.192169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.192344 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:05.192419 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.192858 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.192975 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 08:01:05.194052 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.181820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:49573)
0809 08:01:05.182502 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.182541 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.183413 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.183919 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.183926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.184250 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:05.184690 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.184702 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.185529 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.185533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.186583 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.186593 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.187066 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.187069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.187222 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.187773 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:05.187787 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:05.189318 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:05.191317 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.191322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.191332 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.191568 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.191893 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.191895 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.191896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.192045 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.192427 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:05.192432 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:05.192623 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.192791 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.193122 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":152,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 08:01:05.195294 25171 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:05.195533 25171 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:05.196094 25171 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
I20260809 08:01:05.197885 24975 ts_manager.cc:194] Registered new tserver with Master: f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847)
I20260809 08:01:05.199539 24975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:49573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:01:05.212778 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:05.321768 25176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:05.322041 25176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:05.322085 25176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:05.326337 25176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:05.326398 25176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:05.326457 25176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:01:05.331645 25176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:05.332619 25176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:05.333546 25176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:05.342948 25185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:05.342962 25183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:05.342968 25182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:05.343180 25176 server_base.cc:1034] running on GCE node
I20260809 08:01:05.343667 25176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:05.344259 25176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:05.345438 25176 hybrid_clock.cc:648] HybridClock initialized: now 1786262465345422 us; error 24 us; skew 500 ppm
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:05.348073 25176 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:01:05.348892 25176 webserver.cc:460] Webserver started at http://127.8.51.66:45561/ using document root <none> and password file <none>
I20260809 08:01:05.349390 25176 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:05.349447 25176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:05.349665 25176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:01:05.351594 25176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "d2272f8fa7bb0d80bd8579fca989d46f"
server_key_iv: "4d12e063d88667c0cda8a5a20518ecd0"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.352162 25176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "d2272f8fa7bb0d80bd8579fca989d46f"
server_key_iv: "4d12e063d88667c0cda8a5a20518ecd0"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.355844 25176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 08:01:05.358104 25193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.359262 25176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:01:05.359359 25176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "d2272f8fa7bb0d80bd8579fca989d46f"
server_key_iv: "4d12e063d88667c0cda8a5a20518ecd0"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.359436 25176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:05.371587 25176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:05.374585 25176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:05.374773 25176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:05.375322 25176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:05.376099 25176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:05.376173 25176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.376245 25176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:05.376291 25176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.384977 25176 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33319
I20260809 08:01:05.385012 25315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33319 every 8 connection(s)
I20260809 08:01:05.385916 25176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:01:05.389336 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25176
I20260809 08:01:05.389488 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:01:05.389839 8397 external_mini_cluster.cc:1428] Setting key f80d05a58d9127aa97af53d683a3fe45
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:05.401274 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.387718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:42259 (local address 127.8.51.126:35581)
0809 08:01:05.387868 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.387873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.388747 (+ 874us) server_negotiation.cc:407] Connection header received
0809 08:01:05.390412 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.390419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.390478 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.390546 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:05.392093 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.392607 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.394177 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.394509 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.394667 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.397341 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:05.397345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:05.397349 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:05.397382 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:05.399144 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.399627 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.399631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.399633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.399726 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.400052 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.400057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.400059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.400295 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:05.400412 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.400893 (+ 481us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.401040 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:01:05.401952 25318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.388153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:42259)
0809 08:01:05.388600 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.388642 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.390176 (+ 1534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.390773 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.390780 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.391234 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:05.391931 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.391955 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.392751 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.392758 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.394045 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.394055 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.394703 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.394707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.394878 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.395414 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:05.395440 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:05.397174 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:05.399266 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.399270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.399282 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.399522 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.399822 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.399824 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.399826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.399948 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.400402 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:05.400407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:05.400614 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.400791 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.401032 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":101,"threads_started":1}
I20260809 08:01:05.403209 25316 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:05.403461 25316 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:05.404034 25316 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 08:01:05.405226 24975 ts_manager.cc:194] Registered new tserver with Master: aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319)
I20260809 08:01:05.406132 24975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:42259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:01:05.422405 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:05.537477 25321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:05.537774 25321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:05.537819 25321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:05.542119 25321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:05.542181 25321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:05.542241 25321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:01:05.548627 25321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:05.549829 25321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:05.550843 25321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:05.560576 25326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:05.560580 25327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:05.560576 25329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:05.560956 25321 server_base.cc:1034] running on GCE node
I20260809 08:01:05.561362 25321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:05.562055 25321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:05.563235 25321 hybrid_clock.cc:648] HybridClock initialized: now 1786262465563215 us; error 30 us; skew 500 ppm
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:05.565917 25321 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:01:05.566843 25321 webserver.cc:460] Webserver started at http://127.8.51.67:34113/ using document root <none> and password file <none>
I20260809 08:01:05.567409 25321 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:05.567502 25321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:05.567763 25321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:01:05.569897 25321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "f14ef6b1efa1d26e20f46bff0ae60a99"
server_key_iv: "b9adfe519ed3fad56fecf03da850d15f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.570456 25321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "f14ef6b1efa1d26e20f46bff0ae60a99"
server_key_iv: "b9adfe519ed3fad56fecf03da850d15f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.574196 25321 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 08:01:05.576618 25338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.577925 25321 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 08:01:05.578049 25321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "f14ef6b1efa1d26e20f46bff0ae60a99"
server_key_iv: "b9adfe519ed3fad56fecf03da850d15f"
server_key_version: "encryptionkey@0"
I20260809 08:01:05.578158 25321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:05.603082 25321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:05.606148 25321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:05.606365 25321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:05.606993 25321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:05.607868 25321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:05.607939 25321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.608008 25321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:05.608055 25321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:05.617118 25321 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:44279
I20260809 08:01:05.617147 25455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:44279 every 8 connection(s)
I20260809 08:01:05.618104 25321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:01:05.620481 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25321
I20260809 08:01:05.620615 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:01:05.620968 8397 external_mini_cluster.cc:1428] Setting key db64dc9bc58bf8440ade41d520cc20b3
Aug 09 08:01:05 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262465, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:05.632227 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.620008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:33255 (local address 127.8.51.126:35581)
0809 08:01:05.620163 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.620168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.621485 (+ 1317us) server_negotiation.cc:407] Connection header received
0809 08:01:05.622635 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.622639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.622694 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.622773 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:05.624067 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.624723 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.625972 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.626216 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.626367 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.628754 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:05.628758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:05.628761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:05.628800 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:05.630055 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.630620 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.630624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.630626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.630713 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.631077 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.631081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.631083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.631282 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:05.631395 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.631903 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.632034 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 08:01:05.633040 25458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.620511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:33255)
0809 08:01:05.621313 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.621357 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.622411 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.622978 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.622991 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.623435 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:05.623925 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.623938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.624849 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.624853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.625844 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.625854 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.626406 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.626410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.626582 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.627117 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:05.627134 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:05.628580 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:05.630211 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.630217 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.630233 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.630494 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.630812 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:05.630816 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:05.630818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:05.630974 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:05.631393 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:05.631400 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:05.631661 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.631858 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.632196 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":164,"threads_started":1}
I20260809 08:01:05.634387 25456 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:05.634681 25456 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:05.635264 25456 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
I20260809 08:01:05.636292 24975 ts_manager.cc:194] Registered new tserver with Master: bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:05.636965 24975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:33255
I20260809 08:01:05.647054 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:01:05.656935 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.649091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.8.51.126:35581)
0809 08:01:05.649244 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.649248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.649445 (+ 197us) server_negotiation.cc:407] Connection header received
0809 08:01:05.649635 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.649638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.649696 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.649783 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:05.650500 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.651044 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.651969 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.652259 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.652354 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.653858 (+ 1504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:05.653862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:05.653865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:05.653891 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:05.655185 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.655624 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.655627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.655629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.655727 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:05.656002 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:05.656006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:05.656008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:05.656244 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:05.656391 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.656624 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.656755 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 08:01:05.659871 24975 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:01:05.663026 24975 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:01:05.677696 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.672449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.8.51.66:33319)
0809 08:01:05.673197 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.673212 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.673239 (+ 27us) server_negotiation.cc:407] Connection header received
0809 08:01:05.673312 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.673317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.673507 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.673732 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.673951 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.674929 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.676229 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.676964 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.677077 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.677220 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.677418 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.677511 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":147,"threads_started":1}
I20260809 08:01:05.677700 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.671485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33319 (local address 127.0.0.1:48996)
0809 08:01:05.672729 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.672744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.672824 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.673719 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.673722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.673740 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.673826 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.673832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.675054 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.675060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.676070 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.676080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.677097 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.677100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.677205 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.677242 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.677371 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.677491 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"thread_start_us":92,"threads_started":1}
I20260809 08:01:05.677731 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.672225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.0.0.1:51338)
0809 08:01:05.673306 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.673317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.673429 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.673971 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.673974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.673988 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.674081 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.674089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.675369 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.675373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.676352 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.676358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.677309 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.677311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.677372 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.677389 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.677482 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.677556 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"mutex_wait_us":4,"thread_start_us":102,"threads_started":1}
I20260809 08:01:05.677778 25474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.672845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51338 (local address 127.8.51.67:44279)
0809 08:01:05.673179 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.673198 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.673405 (+ 207us) server_negotiation.cc:407] Connection header received
0809 08:01:05.673628 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.673634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.673831 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.673972 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.674171 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.675222 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.676453 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.676978 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.677101 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.677241 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.677515 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.677645 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":162,"threads_started":1}
I20260809 08:01:05.678396 25469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.671453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34847 (local address 127.0.0.1:40012)
0809 08:01:05.671892 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.671947 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.672094 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.672902 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.672908 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.672930 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.673143 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.673152 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.674697 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.674701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.676039 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.676049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.678027 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.678029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.678091 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.678107 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.678201 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.678270 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":4,"thread_start_us":93,"threads_started":1}
I20260809 08:01:05.679011 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.671608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40012 (local address 127.8.51.65:34847)
0809 08:01:05.672145 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.672161 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.672191 (+ 30us) server_negotiation.cc:407] Connection header received
0809 08:01:05.672270 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.672275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.672496 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.672680 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.673283 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.674521 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.676163 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.676964 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.677077 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.677220 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.678783 (+ 1563us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.678885 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":136,"threads_started":1}
I20260809 08:01:05.680611 25388 tablet_service.cc:1467] Processing CreateTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf (DEFAULT_TABLE table=test-table [id=58a655784f7d4819be65fa19843ad09c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:05.680769 25244 tablet_service.cc:1467] Processing CreateTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf (DEFAULT_TABLE table=test-table [id=58a655784f7d4819be65fa19843ad09c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:05.681732 25244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e56d6fc324c45ea89e09fe80003dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:05.681752 25388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e56d6fc324c45ea89e09fe80003dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:05.683595 25104 tablet_service.cc:1467] Processing CreateTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf (DEFAULT_TABLE table=test-table [id=58a655784f7d4819be65fa19843ad09c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:05.684525 25104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e56d6fc324c45ea89e09fe80003dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:05.687793 25475 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Bootstrap starting.
I20260809 08:01:05.689319 25476 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Bootstrap starting.
I20260809 08:01:05.690294 25475 tablet_bootstrap.cc:654] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:05.691107 25475 log.cc:824] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:05.691222 25477 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap starting.
I20260809 08:01:05.691462 25476 tablet_bootstrap.cc:654] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:05.692764 25476 log.cc:824] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:05.693344 25475 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: No bootstrap required, opened a new log
I20260809 08:01:05.693343 25477 tablet_bootstrap.cc:654] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:05.693573 25475 ts_tablet_manager.cc:1397] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 08:01:05.694442 25477 log.cc:824] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:05.694854 25476 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: No bootstrap required, opened a new log
I20260809 08:01:05.695027 25476 ts_tablet_manager.cc:1397] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 08:01:05.696938 25477 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: No bootstrap required, opened a new log
I20260809 08:01:05.697183 25477 ts_tablet_manager.cc:1397] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:01:05.699008 25476 raft_consensus.cc:348] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.699008 25475 raft_consensus.cc:348] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.699290 25475 raft_consensus.cc:374] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:05.699328 25476 raft_consensus.cc:374] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:05.699383 25476 raft_consensus.cc:729] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee259213e5540f5b1f4b72f9d4e49d7, State: Initialized, Role: FOLLOWER
I20260809 08:01:05.699916 25476 consensus_queue.cc:260] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.701047 25476 ts_tablet_manager.cc:1428] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:01:05.701195 25475 raft_consensus.cc:729] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa336cbf4b094e3cb7a45eccd3b64b0d, State: Initialized, Role: FOLLOWER
I20260809 08:01:05.701352 25456 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
I20260809 08:01:05.701838 25475 consensus_queue.cc:260] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.701804 25477 raft_consensus.cc:348] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.702046 25477 raft_consensus.cc:374] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:05.702092 25477 raft_consensus.cc:729] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Initialized, Role: FOLLOWER
I20260809 08:01:05.702500 25477 consensus_queue.cc:260] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.703051 25316 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
I20260809 08:01:05.703423 25477 ts_tablet_manager.cc:1428] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:01:05.703718 25171 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
I20260809 08:01:05.702888 25475 ts_tablet_manager.cc:1428] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260809 08:01:05.861421 25483 raft_consensus.cc:482] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:05.861652 25483 raft_consensus.cc:504] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.862948 25483 leader_election.cc:288] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:05.863139 25482 raft_consensus.cc:482] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:05.863370 25482 raft_consensus.cc:504] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.865638 25482 leader_election.cc:288] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:05.868541 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.863502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:37991 (local address 127.8.51.66:33319)
0809 08:01:05.863706 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.863712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.863838 (+ 126us) server_negotiation.cc:407] Connection header received
0809 08:01:05.864113 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.864116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.864177 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.864257 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.864602 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.865410 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867108 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867697 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867775 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.867833 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.868339 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.868408 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260809 08:01:05.868531 25474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.863363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:36107 (local address 127.8.51.67:44279)
0809 08:01:05.863577 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.863582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.863944 (+ 362us) server_negotiation.cc:407] Connection header received
0809 08:01:05.864103 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.864106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.864189 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.864267 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.864693 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.865423 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867116 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867696 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867775 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.867833 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.868339 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.868408 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260809 08:01:05.868908 25318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.864743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34847 (local address 127.8.51.66:54553)
0809 08:01:05.864894 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.864908 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.865042 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.865361 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.865364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.865379 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.865477 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.865486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.866476 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.866479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.867657 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.867670 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.868556 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.868560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.868649 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.868669 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.868728 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.868784 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":1}
W20260809 08:01:05.869045 25457 tablet.cc:2369] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:01:05.869138 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.863218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33319 (local address 127.8.51.65:37991)
0809 08:01:05.863748 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.863764 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.863927 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.864281 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.864284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.864299 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.864437 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.864443 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.865653 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.865656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.866958 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.866969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867932 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.868163 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.868216 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.868931 (+ 715us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.868994 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":78,"thread_start_us":118,"threads_started":1}
I20260809 08:01:05.869733 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.864788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:54553 (local address 127.8.51.65:34847)
0809 08:01:05.864882 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.864886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.864986 (+ 100us) server_negotiation.cc:407] Connection header received
0809 08:01:05.865151 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.865154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.865194 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.865262 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.865641 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.866357 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867786 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.868362 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.868456 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.868504 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.869513 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.869598 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":36}
I20260809 08:01:05.869781 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.863218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.8.51.65:36107)
0809 08:01:05.863854 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.863866 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.863984 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.864386 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.864389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.864404 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.864524 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.864533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.865552 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.865556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.866958 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.866969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867936 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.868167 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.868215 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.868713 (+ 498us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.868802 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":282,"thread_start_us":123,"threads_started":1}
I20260809 08:01:05.870095 25265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" is_pre_election: true
I20260809 08:01:05.870222 25124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f833fb1e31e24d6797480ce9edeb34a0" is_pre_election: true
I20260809 08:01:05.870317 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.865665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55387 (local address 127.8.51.67:44279)
0809 08:01:05.866273 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.866280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.866291 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:01:05.866326 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.866329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.866367 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.866747 (+ 380us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:05.866840 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867599 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.868985 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.869649 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.869761 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.869822 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.870143 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.870211 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":116,"threads_started":1}
I20260809 08:01:05.870321 25265 raft_consensus.cc:2454] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 0.
I20260809 08:01:05.870373 25124 raft_consensus.cc:2454] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa336cbf4b094e3cb7a45eccd3b64b0d in term 0.
I20260809 08:01:05.870764 25194 leader_election.cc:302] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa336cbf4b094e3cb7a45eccd3b64b0d, f833fb1e31e24d6797480ce9edeb34a0; no voters:
I20260809 08:01:05.870771 25056 leader_election.cc:302] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa336cbf4b094e3cb7a45eccd3b64b0d, f833fb1e31e24d6797480ce9edeb34a0; no voters:
I20260809 08:01:05.870800 25408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" is_pre_election: true
I20260809 08:01:05.871043 25482 raft_consensus.cc:2781] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:01:05.871065 25408 raft_consensus.cc:2454] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 0.
I20260809 08:01:05.871083 25483 raft_consensus.cc:2781] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:01:05.871141 25482 raft_consensus.cc:482] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:01:05.871158 25483 raft_consensus.cc:482] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:01:05.871186 25482 raft_consensus.cc:3037] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:05.871199 25483 raft_consensus.cc:3037] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:05.871784 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.865415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.8.51.66:55387)
0809 08:01:05.865949 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.865961 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:05.866041 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:05.866476 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:05.866478 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:05.866494 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:05.866643 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.866652 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.867782 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.867785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.868848 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:05.868856 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.869790 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.869797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:05.869903 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.869941 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 08:01:05.870013 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 08:01:05.870077 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":73,"threads_started":1}
I20260809 08:01:05.872294 25408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" is_pre_election: true
I20260809 08:01:05.872416 25408 raft_consensus.cc:2454] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa336cbf4b094e3cb7a45eccd3b64b0d in term 0.
I20260809 08:01:05.872598 25482 raft_consensus.cc:504] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.872648 25483 raft_consensus.cc:504] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.872949 25482 leader_election.cc:288] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [CANDIDATE]: Term 1 election: Requested vote from peers f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:05.873256 25483 leader_election.cc:288] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 election: Requested vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:05.873260 25265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
I20260809 08:01:05.873420 25265 raft_consensus.cc:2379] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f833fb1e31e24d6797480ce9edeb34a0 in current term 1: Already voted for candidate aa336cbf4b094e3cb7a45eccd3b64b0d in this term.
I20260809 08:01:05.873641 25407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
I20260809 08:01:05.873644 25408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
I20260809 08:01:05.873766 25407 raft_consensus.cc:3037] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:05.873911 25124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e56d6fc324c45ea89e09fe80003dcaf" candidate_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f833fb1e31e24d6797480ce9edeb34a0"
I20260809 08:01:05.874081 25124 raft_consensus.cc:2379] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa336cbf4b094e3cb7a45eccd3b64b0d in current term 1: Already voted for candidate f833fb1e31e24d6797480ce9edeb34a0 in this term.
I20260809 08:01:05.874485 25194 leader_election.cc:302] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa336cbf4b094e3cb7a45eccd3b64b0d; no voters: bee259213e5540f5b1f4b72f9d4e49d7, f833fb1e31e24d6797480ce9edeb34a0
I20260809 08:01:05.874646 25482 raft_consensus.cc:2726] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 08:01:05.875048 25407 raft_consensus.cc:2454] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 1.
I20260809 08:01:05.875308 25055 leader_election.cc:302] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee259213e5540f5b1f4b72f9d4e49d7, f833fb1e31e24d6797480ce9edeb34a0; no voters: aa336cbf4b094e3cb7a45eccd3b64b0d
I20260809 08:01:05.875454 25483 raft_consensus.cc:2781] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:01:05.875691 25483 raft_consensus.cc:686] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 LEADER]: Becoming Leader. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Running, Role: LEADER
I20260809 08:01:05.876045 25483 consensus_queue.cc:237] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:05.879022 24973 catalog_manager.cc:5495] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "f833fb1e31e24d6797480ce9edeb34a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } health_report { overall_health: UNKNOWN } } }
W20260809 08:01:05.887036 25317 tablet.cc:2369] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:01:05.911931 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.908286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40022 (local address 127.8.51.65:34847)
0809 08:01:05.908428 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:05.908433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:05.908447 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:01:05.908585 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:05.908588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:05.908643 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:05.908757 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:01:05.909013 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.909643 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.910483 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:05.910703 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:05.910830 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:05.911137 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:01:05.911531 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:01:05.911664 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:05.911734 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 08:01:05.911789 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 08:01:05.917512 25265 raft_consensus.cc:1261] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Refusing update from remote peer f833fb1e31e24d6797480ce9edeb34a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:01:05.917507 25407 raft_consensus.cc:1261] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Refusing update from remote peer f833fb1e31e24d6797480ce9edeb34a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:01:05.918144 25488 consensus_queue.cc:1035] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:01:05.918327 25483 consensus_queue.cc:1035] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:01:05.930630 25494 mvcc.cc:205] Tried to move back new op lower bound from 7316531060391305216 to 7316531060230631424. Current Snapshot: MvccSnapshot[applied={T|T < 7316531060391305216}]
I20260809 08:01:05.936283 24973 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:01:05.936471 24973 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:01:05.939013 24973 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Sending DeleteTablet for 3 replicas of tablet 0e56d6fc324c45ea89e09fe80003dcaf
I20260809 08:01:05.939910 25244 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:48996
I20260809 08:01:05.939988 25104 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:40012
I20260809 08:01:05.940065 25388 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:51338
I20260809 08:01:05.940631 25502 tablet_replica.cc:330] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: stopping tablet replica
I20260809 08:01:05.940742 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25038
I20260809 08:01:05.940754 25501 tablet_replica.cc:330] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: stopping tablet replica
I20260809 08:01:05.941017 25501 raft_consensus.cc:2229] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:01:05.941018 25502 raft_consensus.cc:2229] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:01:05.942039 25501 raft_consensus.cc:2258] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:01:05.942553 25503 tablet_replica.cc:330] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: stopping tablet replica
I20260809 08:01:05.942836 25503 raft_consensus.cc:2229] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:01:05.943166 25503 raft_consensus.cc:2258] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:01:05.943727 25501 ts_tablet_manager.cc:1905] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:01:05.944684 25503 ts_tablet_manager.cc:1905] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:01:05.946696 25501 ts_tablet_manager.cc:1918] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:01:05.946796 25501 log.cc:1196] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/0e56d6fc324c45ea89e09fe80003dcaf
I20260809 08:01:05.947139 25501 ts_tablet_manager.cc:1939] T 0e56d6fc324c45ea89e09fe80003dcaf P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting consensus metadata
I20260809 08:01:05.947440 25503 ts_tablet_manager.cc:1918] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:01:05.947535 25503 log.cc:1196] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/0e56d6fc324c45ea89e09fe80003dcaf
I20260809 08:01:05.947952 25503 ts_tablet_manager.cc:1939] T 0e56d6fc324c45ea89e09fe80003dcaf P bee259213e5540f5b1f4b72f9d4e49d7: Deleting consensus metadata
I20260809 08:01:05.948660 24958 catalog_manager.cc:4841] TS aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): tablet 0e56d6fc324c45ea89e09fe80003dcaf (table test-table [id=58a655784f7d4819be65fa19843ad09c]) successfully deleted
I20260809 08:01:05.949115 24957 catalog_manager.cc:4841] TS bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): tablet 0e56d6fc324c45ea89e09fe80003dcaf (table test-table [id=58a655784f7d4819be65fa19843ad09c]) successfully deleted
W20260809 08:01:05.949400 24957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:34847 (error 108)
I20260809 08:01:05.949618 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25176
I20260809 08:01:05.951092 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:05.950827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34847 (local address 127.0.0.1:40038)
0809 08:01:05.950953 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:05.951022 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 08:01:05.951315 24957 catalog_manager.cc:4584] TS f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e56d6fc324c45ea89e09fe80003dcaf: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34847: connect: Connection refused (error 111)
I20260809 08:01:05.957821 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25321
I20260809 08:01:05.965149 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 24940
I20260809 08:01:25.973097 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--webserver_interface=127.8.51.126
--webserver_port=42905
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:35581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:26.080984 25505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:26.081230 25505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:26.081293 25505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:26.085176 25505 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 08:01:26.085222 25505 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 08:01:26.085237 25505 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 08:01:26.085249 25505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:01:26.085266 25505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:26.085283 25505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:26.085299 25505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:01:26.085312 25505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:01:26.090309 25505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:35581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=42905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:26.091264 25505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:26.092191 25505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:01:26.105093 25505 server_base.cc:1034] running on GCE node
W20260809 08:01:26.105077 25514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.105041 25512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.105041 25511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:26.105991 25505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:26.107071 25505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:26.108227 25505 hybrid_clock.cc:648] HybridClock initialized: now 1786262486108210 us; error 28 us; skew 500 ppm
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:26.111086 25505 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:01:26.111956 25505 webserver.cc:460] Webserver started at http://127.8.51.126:42905/ using document root <none> and password file <none>
I20260809 08:01:26.112479 25505 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:26.112550 25505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:26.116411 25505 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260809 08:01:26.118613 25521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.119881 25505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:01:26.120007 25505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "2509bf38bacd4a178d12febcf628880a"
format_stamp: "Formatted at 2026-08-09 08:01:04 on dist-test-slave-njxd"
server_key: "7a4f55fa250ce491f5a4c94501a7365e"
server_key_iv: "7f09be27c635082d9436d1f925b13604"
server_key_version: "encryptionkey@0"
I20260809 08:01:26.120576 25505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:26.133080 25505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:26.136276 25505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:26.136473 25505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:26.143890 25505 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:35581
I20260809 08:01:26.144187 25575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:35581 every 8 connection(s)
I20260809 08:01:26.144990 25505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:01:26.149852 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25505
I20260809 08:01:26.149940 25576 sys_catalog.cc:263] Verifying existing consensus state
I20260809 08:01:26.150345 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:34847
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=43797
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:01:26.152307 25576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap starting.
I20260809 08:01:26.169145 25576 log.cc:824] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:26.177706 25576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:01:26.178082 25576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap complete.
I20260809 08:01:26.181937 25576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:26.182358 25576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Initialized, Role: FOLLOWER
I20260809 08:01:26.182827 25576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:26.182934 25576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:01:26.183030 25576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:01:26.183130 25576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 1 FOLLOWER]: Advancing to term 2
I20260809 08:01:26.184947 25576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:26.185268 25576 leader_election.cc:302] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2509bf38bacd4a178d12febcf628880a; no voters:
I20260809 08:01:26.185592 25576 leader_election.cc:288] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 08:01:26.185684 25580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Leader election won for term 2
I20260809 08:01:26.185884 25580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 LEADER]: Becoming Leader. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Running, Role: LEADER
I20260809 08:01:26.186259 25580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:26.186791 25576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:01:26.187139 25580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2509bf38bacd4a178d12febcf628880a. Latest consensus state: current_term: 2 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:26.187330 25580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:26.187513 25581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:26.187624 25581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:26.187858 25584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:01:26.192404 25584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:01:26.193086 25584 catalog_manager.cc:1259] Loaded cluster ID: 52a91f27e2c44a2abde855493da6e213
I20260809 08:01:26.193177 25584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:01:26.194953 25584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:01:26.195632 25584 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Loaded TSK: 0
I20260809 08:01:26.205900 25584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Generated new TSK 1
I20260809 08:01:26.206130 25584 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 08:01:26.281741 25578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:26.282007 25578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:26.282081 25578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:26.286587 25578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:26.286664 25578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:26.286754 25578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:01:26.292454 25578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:34847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=43797
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:26.293424 25578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:26.294471 25578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:26.304891 25605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:26.304988 25578 server_base.cc:1034] running on GCE node
W20260809 08:01:26.304863 25604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.305182 25607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:26.305697 25578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:26.306300 25578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:26.307478 25578 hybrid_clock.cc:648] HybridClock initialized: now 1786262486307453 us; error 46 us; skew 500 ppm
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:26.310134 25578 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:01:26.311034 25578 webserver.cc:460] Webserver started at http://127.8.51.65:43797/ using document root <none> and password file <none>
I20260809 08:01:26.311558 25578 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:26.311630 25578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:26.315498 25578 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:01:26.317530 25615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.318715 25578 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:26.318821 25578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "f833fb1e31e24d6797480ce9edeb34a0"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "9eba4b910de07de1af643ca6ce1937bf"
server_key_iv: "cc313516a50e25860e88669cb87d344f"
server_key_version: "encryptionkey@0"
I20260809 08:01:26.319301 25578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:26.337988 25578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:26.341001 25578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:26.341190 25578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:26.341797 25578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:26.342787 25622 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 08:01:26.346711 25578 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 08:01:26.346771 25578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 08:01:26.346832 25578 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 08:01:26.348552 25578 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 08:01:26.348608 25578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 08:01:26.348925 25622 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap starting.
I20260809 08:01:26.359604 25578 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:34847
I20260809 08:01:26.359624 25736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:34847 every 8 connection(s)
I20260809 08:01:26.360795 25578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:01:26.367906 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25578
I20260809 08:01:26.368356 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:33319
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=45561
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:01:26.369546 25622 log.cc:824] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Log is configured to *not* fsync() on all Append() calls
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:26.377362 25622 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:01:26.377790 25622 tablet_bootstrap.cc:492] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap complete.
I20260809 08:01:26.379187 25622 ts_tablet_manager.cc:1397] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.007s
I20260809 08:01:26.379674 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.362920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:49069)
0809 08:01:26.363554 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.363597 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.364442 (+ 845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.365647 (+ 1205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.365655 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.366084 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:26.366527 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.366541 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.367924 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.367928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.369245 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.369257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.370389 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.370393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.370609 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.371275 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:26.371304 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:26.373266 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:26.376089 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.376102 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.376114 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.376447 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.376907 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.376910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.376912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.377072 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.377888 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:26.377894 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:26.378198 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.378397 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.378742 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":168,"threads_started":1}
I20260809 08:01:26.379848 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.362891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:49069 (local address 127.8.51.126:35581)
0809 08:01:26.363293 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.363307 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.363728 (+ 421us) server_negotiation.cc:407] Connection header received
0809 08:01:26.364849 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.364860 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.365240 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.365592 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.366724 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.367747 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.369396 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.370186 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.370408 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.373481 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.373490 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.373511 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.373549 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.375955 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.376596 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.376605 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.376613 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.376793 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.377192 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.377197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.377200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.377752 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.377905 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.378554 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.378910 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":104,"threads_started":1}
I20260809 08:01:26.382375 25737 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:26.382063 25622 raft_consensus.cc:348] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:26.382579 25622 raft_consensus.cc:729] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Initialized, Role: FOLLOWER
I20260809 08:01:26.382655 25737 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:26.383038 25622 consensus_queue.cc:260] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } } peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } }
I20260809 08:01:26.383205 25737 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
I20260809 08:01:26.383956 25622 ts_tablet_manager.cc:1428] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:01:26.385643 25539 ts_manager.cc:194] Registered new tserver with Master: f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847)
I20260809 08:01:26.389089 25539 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:49069
I20260809 08:01:26.391505 25737 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.65@KRBTEST.COM
I20260809 08:01:26.399372 25744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.388492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34847 (local address 127.0.0.1:47786)
0809 08:01:26.389241 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.389281 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.389413 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.390007 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.390013 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.390449 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:26.390569 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.390577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.391970 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.391975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.392872 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.392882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.393666 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.393669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.393749 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.394275 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:26.394287 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:26.395596 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:26.397754 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.397763 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.397767 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.398021 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.398337 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.398340 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.398341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.398417 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.398893 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:26.398897 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:26.398993 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.399111 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.399249 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":123,"threads_started":1}
I20260809 08:01:26.399528 25745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.388652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47786 (local address 127.8.51.65:34847)
0809 08:01:26.389001 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.389013 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.389384 (+ 371us) server_negotiation.cc:407] Connection header received
0809 08:01:26.389568 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.389599 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.389786 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.389903 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.390700 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.391865 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.392969 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.393507 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.393646 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.395726 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.395752 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.395764 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.395788 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.397513 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.398149 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.398155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.398157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.398246 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.398491 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.398494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.398496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.398781 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.398900 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.399216 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.399381 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":114,"threads_started":1}
I20260809 08:01:26.400519 25667 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e56d6fc324c45ea89e09fe80003dcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:47786
I20260809 08:01:26.401463 25746 tablet_replica.cc:330] stopping tablet replica
I20260809 08:01:26.401786 25746 raft_consensus.cc:2229] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:01:26.402014 25746 raft_consensus.cc:2258] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:01:26.402911 25746 ts_tablet_manager.cc:1905] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:01:26.406311 25746 ts_tablet_manager.cc:1918] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:01:26.406390 25746 log.cc:1196] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal/wals/0e56d6fc324c45ea89e09fe80003dcaf
I20260809 08:01:26.406677 25746 ts_tablet_manager.cc:1939] T 0e56d6fc324c45ea89e09fe80003dcaf P f833fb1e31e24d6797480ce9edeb34a0: Deleting consensus metadata
I20260809 08:01:26.408125 25523 catalog_manager.cc:4841] TS f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847): tablet 0e56d6fc324c45ea89e09fe80003dcaf (table test-table [id=58a655784f7d4819be65fa19843ad09c]) successfully deleted
W20260809 08:01:26.487207 25742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:26.487550 25742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:26.487596 25742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:26.491477 25742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:26.491523 25742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:26.491573 25742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:01:26.496397 25742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:33319
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=45561
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:26.497299 25742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:26.498238 25742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:26.507334 25755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.507357 25753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.507432 25752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:26.507583 25742 server_base.cc:1034] running on GCE node
I20260809 08:01:26.508013 25742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:26.508662 25742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:26.509831 25742 hybrid_clock.cc:648] HybridClock initialized: now 1786262486509817 us; error 24 us; skew 500 ppm
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:26.512543 25742 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:01:26.513311 25742 webserver.cc:460] Webserver started at http://127.8.51.66:45561/ using document root <none> and password file <none>
I20260809 08:01:26.513870 25742 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:26.513944 25742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:26.517472 25742 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:01:26.519397 25762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.520576 25742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:26.520691 25742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "d2272f8fa7bb0d80bd8579fca989d46f"
server_key_iv: "4d12e063d88667c0cda8a5a20518ecd0"
server_key_version: "encryptionkey@0"
I20260809 08:01:26.521205 25742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:26.540338 25742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:26.543635 25742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:26.543830 25742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:26.544420 25742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:26.545212 25742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:26.545255 25742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.545316 25742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:26.545352 25742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.554450 25742 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33319
I20260809 08:01:26.554477 25879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33319 every 8 connection(s)
I20260809 08:01:26.555429 25742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:01:26.557708 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25742
I20260809 08:01:26.558235 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:44279
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=34113
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:26.570421 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.557200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:44517 (local address 127.8.51.126:35581)
0809 08:01:26.557332 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.557341 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.558510 (+ 1169us) server_negotiation.cc:407] Connection header received
0809 08:01:26.559896 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.559899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.559945 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.560047 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.561178 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.561858 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.563728 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.563954 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.564035 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.566950 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.566954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.566956 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.566980 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.568427 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.568917 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.568925 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.568926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.569000 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.569327 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.569332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.569334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.569511 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.569644 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.570110 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.570244 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:01:26.571163 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.557520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:44517)
0809 08:01:26.558326 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.558386 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.559683 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.560235 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.560242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.560575 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:26.561016 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.561028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.561984 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.561991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.563599 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.563615 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.564110 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.564117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.564363 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.565004 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:26.565030 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:26.566786 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:26.568540 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.568545 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.568559 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.568812 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.569088 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.569092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.569094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.569236 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.569650 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:26.569659 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:26.569888 (+ 229us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.570070 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.570384 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":128,"threads_started":1}
I20260809 08:01:26.572232 25880 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:26.572463 25880 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:26.572923 25880 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
I20260809 08:01:26.573935 25539 ts_manager.cc:194] Registered new tserver with Master: aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319)
I20260809 08:01:26.574487 25539 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:44517
W20260809 08:01:26.672686 25883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:26.672979 25883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:26.673056 25883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:26.677102 25883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:26.677181 25883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:26.677268 25883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:01:26.682128 25883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:44279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=34113
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:26.683137 25883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:26.684123 25883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:26.693327 25888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.693346 25889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:26.693336 25891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:26.693565 25883 server_base.cc:1034] running on GCE node
I20260809 08:01:26.694157 25883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:26.694823 25883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:26.696002 25883 hybrid_clock.cc:648] HybridClock initialized: now 1786262486695982 us; error 33 us; skew 500 ppm
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:26.698714 25883 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:01:26.699520 25883 webserver.cc:460] Webserver started at http://127.8.51.67:34113/ using document root <none> and password file <none>
I20260809 08:01:26.700042 25883 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:26.700145 25883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:26.703640 25883 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:01:26.705691 25898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.706782 25883 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:26.706913 25883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "f14ef6b1efa1d26e20f46bff0ae60a99"
server_key_iv: "b9adfe519ed3fad56fecf03da850d15f"
server_key_version: "encryptionkey@0"
I20260809 08:01:26.707410 25883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:26.764765 25883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:26.767588 25883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:26.767886 25883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:26.768536 25883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:26.769394 25883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:26.769464 25883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:26.769546 25883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:26.769605 25883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 08:01:26.778159 25883 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:44279
I20260809 08:01:26.778182 26017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:44279 every 8 connection(s)
I20260809 08:01:26.779093 25883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:01:26.786434 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 25883
Aug 09 08:01:26 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262486, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:01:26.793097 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.780834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:44935 (local address 127.8.51.126:35581)
0809 08:01:26.780961 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.780964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.782040 (+ 1076us) server_negotiation.cc:407] Connection header received
0809 08:01:26.782861 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.782863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.782907 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.782981 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.784165 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.784688 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.785858 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.786077 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.786160 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.789212 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.789216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.789219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.789243 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.790798 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.791433 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.791438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.791440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.791573 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.791915 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.791920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.791921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.792104 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.792211 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.792768 (+ 557us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.792883 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 08:01:26.793854 26020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.781183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:44935)
0809 08:01:26.781895 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.781936 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.782676 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.783152 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.783158 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.783539 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:26.784007 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.784029 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.784797 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.784799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.785740 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.785750 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.786245 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.786251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.786452 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.787136 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:26.787195 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:26.789068 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:26.790926 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.790933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.790947 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.791329 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.791673 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:26.791676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:26.791678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:26.791819 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:26.792208 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:26.792216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:26.792452 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.792669 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.792959 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":107,"threads_started":1}
I20260809 08:01:26.794939 26018 heartbeater.cc:347] Connected to a master server at 127.8.51.126:35581
I20260809 08:01:26.795183 26018 heartbeater.cc:464] Registering TS with master...
I20260809 08:01:26.795576 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.787141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50056 (local address 127.8.51.126:35581)
0809 08:01:26.787428 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.787433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.787660 (+ 227us) server_negotiation.cc:407] Connection header received
0809 08:01:26.787791 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.787798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.787839 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.787915 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.788708 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.789311 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.790454 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.790829 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.790925 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.792303 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.792312 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.792315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.792335 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.793989 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.794411 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.794414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.794416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.794495 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.794781 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.794785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.794787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.794947 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.795172 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.795299 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.795411 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":103,"threads_started":1}
I20260809 08:01:26.795747 26018 heartbeater.cc:511] Master 127.8.51.126:35581 requested a full tablet report, sending...
I20260809 08:01:26.796793 25538 ts_manager.cc:194] Registered new tserver with Master: bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:26.797425 25538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:44935
I20260809 08:01:26.808761 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:01:26.812338 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.809330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.8.51.126:35581)
0809 08:01:26.809429 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.809432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.809553 (+ 121us) server_negotiation.cc:407] Connection header received
0809 08:01:26.809743 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.809745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.809839 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.809915 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:01:26.810101 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.810595 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.811368 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.811620 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.811699 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.811939 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:01:26.812052 (+ 113us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 08:01:26.812256 (+ 204us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50072: token expired
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 08:01:26.812414 26021 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50072: token expired
W20260809 08:01:26.812726 25462 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.51.126:35581)
I20260809 08:01:26.819208 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.813058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50082 (local address 127.8.51.126:35581)
0809 08:01:26.813164 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.813167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.813178 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:01:26.813251 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.813253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.813283 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.813339 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:26.813951 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.814393 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.815138 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.815325 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.815397 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.816548 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:26.816551 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:26.816553 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:26.816573 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:26.818017 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.818363 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.818365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.818366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.818435 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:26.818643 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:26.818645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:26.818646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:26.818792 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:26.818883 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.819027 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.819109 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:01:26.821416 25538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:01:26.825008 25538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:01:26.832774 25667 tablet_service.cc:1467] Processing CreateTablet for tablet adc12be3793844b688331e30e9a3c099 (DEFAULT_TABLE table=test-table [id=086a64c32e0741b8a0216875540f122c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:26.833459 25667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc12be3793844b688331e30e9a3c099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:26.836503 25622 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap starting.
I20260809 08:01:26.837046 25744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.831597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33319 (local address 127.0.0.1:45660)
0809 08:01:26.832153 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.832167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.832277 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.832826 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.832829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.832845 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:26.832930 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.832935 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.834270 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.834273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.835489 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.835500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.836622 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.836626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.836716 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.836765 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.836838 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.836921 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485}
I20260809 08:01:26.837307 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.831739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45660 (local address 127.8.51.66:33319)
0809 08:01:26.832086 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.832099 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.832245 (+ 146us) server_negotiation.cc:407] Connection header received
0809 08:01:26.832436 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.832443 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.832670 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.832839 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:26.833024 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.834163 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.835624 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.836466 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.836616 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.837007 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.837060 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.837165 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":152,"threads_started":1}
I20260809 08:01:26.837399 25622 tablet_bootstrap.cc:654] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:26.838836 25622 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: No bootstrap required, opened a new log
I20260809 08:01:26.838939 25622 ts_tablet_manager.cc:1397] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:26.839423 25622 raft_consensus.cc:348] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.839536 25622 raft_consensus.cc:374] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:26.839558 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.831814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.0.0.1:51536)
0809 08:01:26.834385 (+ 2571us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.834398 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.834497 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.834975 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.834978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.834998 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:26.835118 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.835130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.836239 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.836243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.838062 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.838090 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.839123 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.839127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.839231 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.839256 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.839337 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.839418 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2506,"thread_start_us":93,"threads_started":1}
I20260809 08:01:26.839582 25622 raft_consensus.cc:729] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Initialized, Role: FOLLOWER
I20260809 08:01:26.839602 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.832352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.8.51.67:44279)
0809 08:01:26.832676 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.832687 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.834509 (+ 1822us) server_negotiation.cc:407] Connection header received
0809 08:01:26.834609 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.834615 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.834822 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.834975 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:26.835247 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.836127 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.838223 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.839009 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.839123 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.839253 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.839361 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.839460 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":141,"threads_started":1}
I20260809 08:01:26.839745 25622 consensus_queue.cc:260] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.840025 25622 ts_tablet_manager.cc:1428] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 08:01:26.840381 25812 tablet_service.cc:1467] Processing CreateTablet for tablet adc12be3793844b688331e30e9a3c099 (DEFAULT_TABLE table=test-table [id=086a64c32e0741b8a0216875540f122c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:26.841428 25812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc12be3793844b688331e30e9a3c099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:26.842264 25949 tablet_service.cc:1467] Processing CreateTablet for tablet adc12be3793844b688331e30e9a3c099 (DEFAULT_TABLE table=test-table [id=086a64c32e0741b8a0216875540f122c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:01:26.843118 25949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc12be3793844b688331e30e9a3c099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:01:26.848716 26031 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Bootstrap starting.
I20260809 08:01:26.849432 26032 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Bootstrap starting.
I20260809 08:01:26.851200 26031 tablet_bootstrap.cc:654] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:26.851598 26032 tablet_bootstrap.cc:654] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Neither blocks nor log segments found. Creating new log.
I20260809 08:01:26.851969 26031 log.cc:824] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:26.852270 26032 log.cc:824] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:26.853945 26031 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: No bootstrap required, opened a new log
I20260809 08:01:26.854069 26032 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: No bootstrap required, opened a new log
I20260809 08:01:26.854171 26031 ts_tablet_manager.cc:1397] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:01:26.854264 26032 ts_tablet_manager.cc:1397] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260809 08:01:26.857354 26032 raft_consensus.cc:348] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.857358 26031 raft_consensus.cc:348] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.857609 26032 raft_consensus.cc:374] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:26.857637 26031 raft_consensus.cc:374] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:01:26.857700 26031 raft_consensus.cc:729] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa336cbf4b094e3cb7a45eccd3b64b0d, State: Initialized, Role: FOLLOWER
I20260809 08:01:26.857699 26032 raft_consensus.cc:729] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee259213e5540f5b1f4b72f9d4e49d7, State: Initialized, Role: FOLLOWER
I20260809 08:01:26.858129 26032 consensus_queue.cc:260] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.858127 26031 consensus_queue.cc:260] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.858736 26018 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
I20260809 08:01:26.859058 26032 ts_tablet_manager.cc:1428] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260809 08:01:26.859091 26031 ts_tablet_manager.cc:1428] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 08:01:26.859320 25880 heartbeater.cc:503] Master 127.8.51.126:35581 was elected leader, sending a full tablet report...
W20260809 08:01:26.861940 25738 tablet.cc:2369] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:01:26.973429 25743 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:26.973717 25743 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.974974 25743 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:26.980262 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.975415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:37981 (local address 127.8.51.67:44279)
0809 08:01:26.975611 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.975615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.975788 (+ 173us) server_negotiation.cc:407] Connection header received
0809 08:01:26.975911 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.975914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.975961 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.976066 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:26.976442 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.977226 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.978962 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.979579 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.979690 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.979754 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.980068 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.980131 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 08:01:26.980262 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.975323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:56715 (local address 127.8.51.66:33319)
0809 08:01:26.975474 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:26.975478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:26.975710 (+ 232us) server_negotiation.cc:407] Connection header received
0809 08:01:26.975901 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:26.975904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:26.975961 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:26.976063 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:01:26.976442 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.977225 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.978962 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.979584 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.979690 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.979753 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:26.980063 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 08:01:26.980131 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 08:01:26.980340 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.975318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.8.51.65:37981)
0809 08:01:26.975713 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.975726 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.975803 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.976085 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.976089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.976136 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:26.976333 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.976338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.977339 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.977342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.978845 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.978851 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.979712 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.979715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.979875 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.979965 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.980038 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.980155 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":259,"spinlock_wait_cycles":33536,"thread_start_us":82,"threads_started":1}
I20260809 08:01:26.980345 26037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:26.975210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33319 (local address 127.8.51.65:56715)
0809 08:01:26.975600 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:26.975617 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:26.975759 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:26.976085 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:26.976088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:26.976135 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:01:26.976325 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.976334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.977339 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.977342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.978839 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:26.978851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:26.979712 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:26.979715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:26.979880 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:26.979959 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 08:01:26.980039 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 08:01:26.980155 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":255,"spinlock_wait_cycles":29312,"thread_start_us":107,"threads_started":1}
I20260809 08:01:26.981009 25970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc12be3793844b688331e30e9a3c099" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" is_pre_election: true
I20260809 08:01:26.981027 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc12be3793844b688331e30e9a3c099" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" is_pre_election: true
I20260809 08:01:26.981299 25833 raft_consensus.cc:2454] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 0.
I20260809 08:01:26.981307 25970 raft_consensus.cc:2454] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 0.
I20260809 08:01:26.981823 25616 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7, f833fb1e31e24d6797480ce9edeb34a0; no voters:
I20260809 08:01:26.982086 25743 raft_consensus.cc:2781] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:01:26.982161 25743 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:01:26.982201 25743 raft_consensus.cc:3037] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:26.983229 25743 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.983606 25743 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 election: Requested vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
I20260809 08:01:26.983944 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc12be3793844b688331e30e9a3c099" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
I20260809 08:01:26.983944 25970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc12be3793844b688331e30e9a3c099" candidate_uuid: "f833fb1e31e24d6797480ce9edeb34a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
I20260809 08:01:26.984061 25833 raft_consensus.cc:3037] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:26.984074 25970 raft_consensus.cc:3037] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:01:26.985321 25970 raft_consensus.cc:2454] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 1.
I20260809 08:01:26.985321 25833 raft_consensus.cc:2454] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f833fb1e31e24d6797480ce9edeb34a0 in term 1.
I20260809 08:01:26.985630 25616 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7, f833fb1e31e24d6797480ce9edeb34a0; no voters:
I20260809 08:01:26.985769 25743 raft_consensus.cc:2781] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:01:26.985932 25743 raft_consensus.cc:686] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 LEADER]: Becoming Leader. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Running, Role: LEADER
I20260809 08:01:26.986198 25743 consensus_queue.cc:237] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:26.989130 25539 catalog_manager.cc:5495] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "f833fb1e31e24d6797480ce9edeb34a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } health_report { overall_health: HEALTHY } } }
I20260809 08:01:27.027125 26041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:27.023294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47798 (local address 127.8.51.65:34847)
0809 08:01:27.023669 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:27.023677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:27.023688 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:01:27.023763 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:27.023765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:27.023819 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:27.023946 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:01:27.024187 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:27.024807 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:27.025719 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:27.025941 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:27.026044 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:27.026307 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:01:27.026737 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:01:27.026862 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:27.026922 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 08:01:27.026974 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":134,"threads_started":1}
W20260809 08:01:27.030073 26019 tablet.cc:2369] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:01:27.030956 25970 raft_consensus.cc:1261] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Refusing update from remote peer f833fb1e31e24d6797480ce9edeb34a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:01:27.030958 25833 raft_consensus.cc:1261] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Refusing update from remote peer f833fb1e31e24d6797480ce9edeb34a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:01:27.031639 26039 consensus_queue.cc:1035] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:01:27.031832 25743 consensus_queue.cc:1035] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:01:27.047922 25538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:01:27.048094 25538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:01:27.050406 25538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Sending DeleteTablet for 3 replicas of tablet adc12be3793844b688331e30e9a3c099
I20260809 08:01:27.051091 25667 tablet_service.cc:1514] Processing DeleteTablet for tablet adc12be3793844b688331e30e9a3c099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:27 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:47786
I20260809 08:01:27.051070 25812 tablet_service.cc:1514] Processing DeleteTablet for tablet adc12be3793844b688331e30e9a3c099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:27 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:45660
I20260809 08:01:27.051472 25949 tablet_service.cc:1514] Processing DeleteTablet for tablet adc12be3793844b688331e30e9a3c099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:01:27 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:51536
I20260809 08:01:27.051564 26054 tablet_replica.cc:330] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: stopping tablet replica
I20260809 08:01:27.051776 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25578
I20260809 08:01:27.051875 26054 raft_consensus.cc:2229] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:01:27.052142 26054 raft_consensus.cc:2258] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:01:27.053910 26054 ts_tablet_manager.cc:1905] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:01:27.054250 26055 tablet_replica.cc:330] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: stopping tablet replica
I20260809 08:01:27.054620 26055 raft_consensus.cc:2229] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:01:27.054945 26055 raft_consensus.cc:2258] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:01:27.056197 26055 ts_tablet_manager.cc:1905] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:01:27.057396 26054 ts_tablet_manager.cc:1918] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:01:27.057507 26054 log.cc:1196] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/adc12be3793844b688331e30e9a3c099
I20260809 08:01:27.057914 26054 ts_tablet_manager.cc:1939] T adc12be3793844b688331e30e9a3c099 P aa336cbf4b094e3cb7a45eccd3b64b0d: Deleting consensus metadata
I20260809 08:01:27.058578 26055 ts_tablet_manager.cc:1918] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:01:27.058686 26055 log.cc:1196] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/adc12be3793844b688331e30e9a3c099
I20260809 08:01:27.059060 26055 ts_tablet_manager.cc:1939] T adc12be3793844b688331e30e9a3c099 P bee259213e5540f5b1f4b72f9d4e49d7: Deleting consensus metadata
I20260809 08:01:27.059237 25524 catalog_manager.cc:4841] TS aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): tablet adc12be3793844b688331e30e9a3c099 (table test-table [id=086a64c32e0741b8a0216875540f122c]) successfully deleted
I20260809 08:01:27.060099 25523 catalog_manager.cc:4841] TS bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): tablet adc12be3793844b688331e30e9a3c099 (table test-table [id=086a64c32e0741b8a0216875540f122c]) successfully deleted
W20260809 08:01:27.061161 25523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:34847 (error 108)
I20260809 08:01:27.061463 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25742
I20260809 08:01:27.067251 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:27.066929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34847 (local address 127.0.0.1:47806)
0809 08:01:27.067060 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:27.067144 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 08:01:27.067530 25523 catalog_manager.cc:4584] TS f833fb1e31e24d6797480ce9edeb34a0 (127.8.51.65:34847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet adc12be3793844b688331e30e9a3c099: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34847: connect: Connection refused (error 111)
I20260809 08:01:27.071158 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25883
I20260809 08:01:27.079212 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 25505
I20260809 08:01:47.086651 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--webserver_interface=127.8.51.126
--webserver_port=42905
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:35581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:01:47.193967 26057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:47.194216 26057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:47.194254 26057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:47.198077 26057 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 08:01:47.198118 26057 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 08:01:47.198133 26057 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 08:01:47.198148 26057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:01:47.198195 26057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:47.198230 26057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:47.198249 26057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:01:47.198283 26057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:01:47.203195 26057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:35581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:35581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=42905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:47.204238 26057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:47.205226 26057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:47.214088 26063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.214118 26065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.214174 26057 server_base.cc:1034] running on GCE node
W20260809 08:01:47.214119 26062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.214895 26057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:47.215961 26057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:47.217154 26057 hybrid_clock.cc:648] HybridClock initialized: now 1786262507217142 us; error 29 us; skew 500 ppm
Aug 09 08:01:47 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:47.223362 26057 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:01:47.224296 26057 webserver.cc:460] Webserver started at http://127.8.51.126:42905/ using document root <none> and password file <none>
I20260809 08:01:47.224885 26057 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:47.224978 26057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:47.228848 26057 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 08:01:47.231076 26072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.232290 26057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:01:47.232431 26057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "2509bf38bacd4a178d12febcf628880a"
format_stamp: "Formatted at 2026-08-09 08:01:04 on dist-test-slave-njxd"
server_key: "7a4f55fa250ce491f5a4c94501a7365e"
server_key_iv: "7f09be27c635082d9436d1f925b13604"
server_key_version: "encryptionkey@0"
I20260809 08:01:47.232985 26057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:47.264642 26057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:47.268069 26057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:47.268299 26057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:47.275888 26057 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:35581
I20260809 08:01:47.276212 26130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:35581 every 8 connection(s)
I20260809 08:01:47.276997 26057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:01:47.281167 26131 sys_catalog.cc:263] Verifying existing consensus state
I20260809 08:01:47.282709 26131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap starting.
I20260809 08:01:47.284329 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26057
I20260809 08:01:47.284744 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:34847
--local_ip_for_outbound_sockets=127.8.51.65
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=43797
--webserver_interface=127.8.51.65
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:01:47.299366 26131 log.cc:824] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:47.310325 26131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:01:47.310684 26131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Bootstrap complete.
I20260809 08:01:47.314635 26131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:47.314996 26131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Initialized, Role: FOLLOWER
I20260809 08:01:47.315493 26131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:47.315606 26131 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:01:47.315693 26131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:01:47.315806 26131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 2 FOLLOWER]: Advancing to term 3
I20260809 08:01:47.317728 26131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:47.318045 26131 leader_election.cc:302] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2509bf38bacd4a178d12febcf628880a; no voters:
I20260809 08:01:47.318358 26131 leader_election.cc:288] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 08:01:47.318462 26135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 3 FOLLOWER]: Leader election won for term 3
I20260809 08:01:47.318672 26135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [term 3 LEADER]: Becoming Leader. State: Replica: 2509bf38bacd4a178d12febcf628880a, State: Running, Role: LEADER
I20260809 08:01:47.318996 26135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } }
I20260809 08:01:47.319581 26131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:01:47.320488 26136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:47.320621 26136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:47.320986 26144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:01:47.320971 26137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2509bf38bacd4a178d12febcf628880a. Latest consensus state: current_term: 3 leader_uuid: "2509bf38bacd4a178d12febcf628880a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2509bf38bacd4a178d12febcf628880a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 35581 } } }
I20260809 08:01:47.321139 26137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a [sys.catalog]: This master's current role is: LEADER
I20260809 08:01:47.326184 26144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:01:47.326911 26144 catalog_manager.cc:1259] Loaded cluster ID: 52a91f27e2c44a2abde855493da6e213
I20260809 08:01:47.326988 26144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:01:47.329463 26144 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:01:47.330191 26144 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Loaded TSK: 0
I20260809 08:01:47.330276 26144 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2509bf38bacd4a178d12febcf628880a: Loaded TSK: 1
F20260809 08:01:47.331005 26144 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f43e73e99ad google::LogMessage::Fail() at ??:0
@ 0x7f43e73ec88a google::LogMessage::SendToLog() at ??:0
@ 0x7f43e73e94de google::LogMessage::Flush() at ??:0
@ 0x7f43e73eaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f43ea0ad18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f43ea0a5f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f43f1d527bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f43f1d2c99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f43f1d2d178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f43f1d6edf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f43f1d8d82b std::function<>::operator()() at ??:0
@ 0x7f43f1d2cb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f43f1d2df3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f43f1d2a579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f43f1d6e640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f43e963b3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f43e963bc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f43e963d3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f43e962c512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f43eac706db start_thread at ??:0
@ 0x7f43e5ee761f clone at ??:0
W20260809 08:01:47.423148 26133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:47.423398 26133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:47.423465 26133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:47.427945 26133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:47.427989 26133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:47.428045 26133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:01:47.433516 26133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:34847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=43797
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:47.434657 26133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:47.435714 26133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:47.446067 26178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.446077 26181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.446080 26179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.446784 26133 server_base.cc:1034] running on GCE node
I20260809 08:01:47.447230 26133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:47.447952 26133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:47.449141 26133 hybrid_clock.cc:648] HybridClock initialized: now 1786262507449090 us; error 61 us; skew 500 ppm
Aug 09 08:01:47 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:47.452239 26133 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:01:47.453246 26133 webserver.cc:460] Webserver started at http://127.8.51.65:43797/ using document root <none> and password file <none>
I20260809 08:01:47.453918 26133 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:47.453986 26133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:47.458209 26133 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:01:47.460580 26189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.462080 26133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:01:47.462218 26133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "f833fb1e31e24d6797480ce9edeb34a0"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "9eba4b910de07de1af643ca6ce1937bf"
server_key_iv: "cc313516a50e25860e88669cb87d344f"
server_key_version: "encryptionkey@0"
I20260809 08:01:47.462785 26133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:47.505476 26133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:47.509037 26133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:47.509268 26133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:47.510052 26133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:47.511300 26196 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 08:01:47.517107 26133 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 08:01:47.517196 26133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260809 08:01:47.517285 26133 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 08:01:47.519081 26133 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 08:01:47.519162 26133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 08:01:47.519472 26196 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap starting.
I20260809 08:01:47.530176 26133 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:34847
I20260809 08:01:47.530440 26309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:34847 every 8 connection(s)
I20260809 08:01:47.531261 26133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:01:47.532581 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26133
I20260809 08:01:47.533046 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:33319
--local_ip_for_outbound_sockets=127.8.51.66
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=45561
--webserver_interface=127.8.51.66
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:01:47.540820 26196 log.cc:824] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Log is configured to *not* fsync() on all Append() calls
I20260809 08:01:47.548170 26196 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 08:01:47.548597 26196 tablet_bootstrap.cc:492] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Bootstrap complete.
I20260809 08:01:47.549808 26196 ts_tablet_manager.cc:1397] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.013s
I20260809 08:01:47.552342 26196 raft_consensus.cc:348] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:47.552811 26196 raft_consensus.cc:729] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833fb1e31e24d6797480ce9edeb34a0, State: Initialized, Role: FOLLOWER
I20260809 08:01:47.553323 26196 consensus_queue.cc:260] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:47.554352 26196 ts_tablet_manager.cc:1428] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260809 08:01:47.586076 26313 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:01:47.534754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:48551)
0809 08:01:47.536041 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.536104 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:47.537170 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:47.585205 (+ 48035us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1043,"thread_start_us":137,"threads_started":1}
W20260809 08:01:47.586611 26310 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:35581 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:35581: Client connection negotiation failed: client connection to 127.8.51.126:35581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 08:01:47.587390 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.587151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:44387)
0809 08:01:47.587278 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.587337 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 08:01:47.588109 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.587897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:42619)
0809 08:01:47.588001 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.588053 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 08:01:47.588310 26310 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 08:01:47.665926 26312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:47.666234 26312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:47.666309 26312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:47.670396 26312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:47.670498 26312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:47.670594 26312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:01:47.676056 26312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:33319
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=45561
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:47.677193 26312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:47.678346 26312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:47.688445 26321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.688462 26323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.688445 26320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.689248 26312 server_base.cc:1034] running on GCE node
I20260809 08:01:47.689764 26312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:47.690595 26312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:47.691788 26312 hybrid_clock.cc:648] HybridClock initialized: now 1786262507691757 us; error 43 us; skew 500 ppm
Aug 09 08:01:47 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:47.694554 26312 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:01:47.695425 26312 webserver.cc:460] Webserver started at http://127.8.51.66:45561/ using document root <none> and password file <none>
I20260809 08:01:47.696018 26312 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:47.696111 26312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:47.699952 26312 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260809 08:01:47.701987 26330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.703197 26312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:47.703323 26312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "d2272f8fa7bb0d80bd8579fca989d46f"
server_key_iv: "4d12e063d88667c0cda8a5a20518ecd0"
server_key_version: "encryptionkey@0"
I20260809 08:01:47.703878 26312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:47.716271 26312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:47.718927 26312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:47.719112 26312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:47.719655 26312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:47.720546 26312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:47.720615 26312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.720695 26312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:47.720731 26312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.729257 26312 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:33319
I20260809 08:01:47.729298 26447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:33319 every 8 connection(s)
I20260809 08:01:47.730252 26312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:01:47.733654 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.732211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:54937)
0809 08:01:47.732844 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.732946 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":114,"threads_started":1}
W20260809 08:01:47.734058 26448 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:35581 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:35581: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
I20260809 08:01:47.734675 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.734396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:46763)
0809 08:01:47.734541 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.734605 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 08:01:47.734782 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26312
I20260809 08:01:47.735239 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:44279
--local_ip_for_outbound_sockets=127.8.51.67
--tserver_master_addrs=127.8.51.126:35581
--webserver_port=34113
--webserver_interface=127.8.51.67
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:01:47.735545 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.735261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:52309)
0809 08:01:47.735413 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.735472 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 08:01:47.735760 26448 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 08:01:47.846890 26451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:01:47.847122 26451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:01:47.847164 26451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:01:47.851122 26451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:01:47.851176 26451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:01:47.851272 26451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:01:47.856351 26451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:44279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=34113
--tserver_master_addrs=127.8.51.126:35581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:01:47.857338 26451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:01:47.858376 26451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:01:47.867503 26457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:01:47.867573 26458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.867574 26451 server_base.cc:1034] running on GCE node
W20260809 08:01:47.867503 26460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:01:47.868054 26451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:01:47.868643 26451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:01:47.869830 26451 hybrid_clock.cc:648] HybridClock initialized: now 1786262507869817 us; error 24 us; skew 500 ppm
Aug 09 08:01:47 dist-test-slave-njxd krb5kdc[24927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:01:47.872463 26451 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:01:47.873255 26451 webserver.cc:460] Webserver started at http://127.8.51.67:34113/ using document root <none> and password file <none>
I20260809 08:01:47.873857 26451 fs_manager.cc:359] Metadata directory not provided
I20260809 08:01:47.873950 26451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:01:47.877468 26451 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:01:47.879372 26467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.880510 26451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:01:47.880636 26451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "bee259213e5540f5b1f4b72f9d4e49d7"
format_stamp: "Formatted at 2026-08-09 08:01:05 on dist-test-slave-njxd"
server_key: "f14ef6b1efa1d26e20f46bff0ae60a99"
server_key_iv: "b9adfe519ed3fad56fecf03da850d15f"
server_key_version: "encryptionkey@0"
I20260809 08:01:47.881139 26451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:01:47.891283 26451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:01:47.894179 26451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:01:47.894364 26451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:01:47.894946 26451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:01:47.895720 26451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:01:47.895792 26451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.895864 26451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:01:47.895912 26451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:01:47.904440 26451 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:44279
I20260809 08:01:47.904474 26587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:44279 every 8 connection(s)
I20260809 08:01:47.905400 26451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:01:47.908986 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.907479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:37317)
0809 08:01:47.908190 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.908308 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":118,"threads_started":1}
W20260809 08:01:47.909484 26588 heartbeater.cc:644] Failed to heartbeat to 127.8.51.126:35581 (0 consecutive failures): Network error: Failed to ping master at 127.8.51.126:35581: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
I20260809 08:01:47.910122 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.909915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:51463)
0809 08:01:47.910027 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.910071 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 08:01:47.910786 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:47.910605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:38705)
0809 08:01:47.910699 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:47.910739 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 08:01:47.910964 26588 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 08:01:47.912408 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26451
I20260809 08:01:48.589257 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:48.588844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:43643)
0809 08:01:48.589089 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:48.589139 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":88,"threads_started":1}
I20260809 08:01:48.736789 26593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:48.736345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:58115)
0809 08:01:48.736618 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:48.736689 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":69,"threads_started":1}
I20260809 08:01:48.912071 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:48.911653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:54285)
0809 08:01:48.911922 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:48.911979 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":104,"threads_started":1}
I20260809 08:01:49.020427 26595 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:49.020704 26595 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:49.021852 26595 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
Aug 09 08:01:49 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.67@KRBTEST.COM
Aug 09 08:01:49 dist-test-slave-njxd krb5kdc[24927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262507, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.66@KRBTEST.COM
I20260809 08:01:49.035266 26597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.022292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:41251 (local address 127.8.51.67:44279)
0809 08:01:49.022728 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:49.022747 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:49.022786 (+ 39us) server_negotiation.cc:407] Connection header received
0809 08:01:49.023610 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:49.023616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:49.023910 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:49.024207 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:49.025453 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.026479 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.027656 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.028094 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.028261 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:49.030761 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:49.030767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:49.030782 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:49.030814 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:49.032603 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033239 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:49.033243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:49.033247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:49.033348 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033796 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:49.033799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:49.033800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:49.034146 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:49.034287 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:49.034845 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 08:01:49.035097 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":91,"threads_started":1}
I20260809 08:01:49.035251 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.022129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:33319 (local address 127.8.51.65:53999)
0809 08:01:49.022261 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:49.022277 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:49.022383 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:49.024294 (+ 1911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:49.024300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:49.024833 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:49.025277 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:49.025290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.026626 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.026629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:49.027528 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:49.027537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.028232 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.028235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:49.028464 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:49.029093 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:49.029108 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:49.030901 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:49.032811 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:49.032813 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:49.032815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:49.033077 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:49.033427 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033433 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:49.033435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:49.033650 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:49.034264 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:49.034270 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:49.034519 (+ 249us) client_negotiation.cc:769] Sending connection context
0809 08:01:49.034730 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 08:01:49.035060 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":204,"spinlock_wait_cycles":28544}
I20260809 08:01:49.035379 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.022126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:44279 (local address 127.8.51.65:41251)
0809 08:01:49.022710 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:49.022724 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:01:49.022819 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:01:49.024294 (+ 1475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:01:49.024300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:01:49.024841 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:01:49.025276 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:49.025290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.026623 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.026627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:49.027526 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:01:49.027534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.028230 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.028234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:01:49.028467 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:49.029148 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:01:49.029159 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:01:49.030542 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:01:49.032723 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:49.032731 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:49.032747 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:49.033102 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:49.033470 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:01:49.033474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:01:49.033688 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:01:49.034263 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:01:49.034270 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:01:49.034519 (+ 249us) client_negotiation.cc:769] Sending connection context
0809 08:01:49.034725 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 08:01:49.035167 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":526,"spinlock_wait_cycles":236288,"thread_start_us":70,"threads_started":1}
I20260809 08:01:49.035624 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.022266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:53999 (local address 127.8.51.66:33319)
0809 08:01:49.022580 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0809 08:01:49.022606 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 08:01:49.022665 (+ 59us) server_negotiation.cc:407] Connection header received
0809 08:01:49.023545 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:01:49.023554 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:01:49.023910 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:01:49.024208 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:01:49.025453 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.026483 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.027660 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:01:49.028095 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:01:49.028261 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:01:49.031070 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:01:49.031074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:01:49.031084 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:01:49.031109 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:01:49.032696 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033187 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:49.033195 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:49.033203 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:49.033328 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:01:49.033751 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:01:49.033756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:01:49.033758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:01:49.034142 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:01:49.034287 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 08:01:49.035175 (+ 888us) server_negotiation.cc:299] Negotiation successful
0809 08:01:49.035442 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":109,"threads_started":1}
W20260809 08:01:49.038292 26190 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
W20260809 08:01:49.038522 26191 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
I20260809 08:01:49.038600 26191 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f833fb1e31e24d6797480ce9edeb34a0; no voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7
I20260809 08:01:49.038810 26595 raft_consensus.cc:2726] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:01:49.590662 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.590218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:50321)
0809 08:01:49.590486 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:49.590550 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":81,"threads_started":1}
I20260809 08:01:49.737938 26600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.737492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:55083)
0809 08:01:49.737796 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:49.737851 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":124,"threads_started":1}
I20260809 08:01:49.913203 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:49.912830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:32779)
0809 08:01:49.913069 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:49.913122 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
I20260809 08:01:50.591892 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:50.591484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:58333)
0809 08:01:50.591741 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:50.591795 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260809 08:01:50.739053 26603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:50.738676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:35763)
0809 08:01:50.738909 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:50.738965 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":71,"threads_started":1}
I20260809 08:01:50.914330 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:50.913952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:59871)
0809 08:01:50.914188 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:50.914242 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
I20260809 08:01:51.163857 26605 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:51.163993 26605 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:51.164359 26605 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
W20260809 08:01:51.165202 26191 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
W20260809 08:01:51.165339 26190 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
I20260809 08:01:51.165438 26190 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f833fb1e31e24d6797480ce9edeb34a0; no voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7
I20260809 08:01:51.165648 26605 raft_consensus.cc:2726] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:01:51.593204 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:51.592699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:57535)
0809 08:01:51.592975 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:51.593065 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":77,"threads_started":1}
I20260809 08:01:51.740185 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:51.739809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:52711)
0809 08:01:51.740043 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:51.740097 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260809 08:01:51.915380 26609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:51.915010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:34439)
0809 08:01:51.915239 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:51.915293 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":73,"threads_started":1}
I20260809 08:01:52.594548 26610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:52.594119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:57635)
0809 08:01:52.594389 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:52.594442 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":68,"threads_started":1}
I20260809 08:01:52.741250 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:52.740851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:35581)
0809 08:01:52.741099 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:52.741151 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260809 08:01:52.916543 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:52.916126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:48299)
0809 08:01:52.916394 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:52.916450 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":74,"threads_started":1}
I20260809 08:01:53.595708 26613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:53.595297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:42613)
0809 08:01:53.595557 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:53.595610 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
I20260809 08:01:53.742434 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:53.741994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:50033)
0809 08:01:53.742294 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:53.742343 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":106,"threads_started":1}
I20260809 08:01:53.917735 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:53.917249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:38281)
0809 08:01:53.917489 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:53.917544 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260809 08:01:54.368646 26616 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:54.368793 26616 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:54.369163 26616 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
W20260809 08:01:54.370034 26190 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
W20260809 08:01:54.370144 26191 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
I20260809 08:01:54.370213 26191 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f833fb1e31e24d6797480ce9edeb34a0; no voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7
I20260809 08:01:54.370352 26616 raft_consensus.cc:2726] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:01:54.596800 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:54.596403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:54981)
0809 08:01:54.596652 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:54.596705 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":85,"threads_started":1}
I20260809 08:01:54.743520 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:54.743099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:40039)
0809 08:01:54.743387 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:54.743435 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":87,"threads_started":1}
I20260809 08:01:54.918776 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:54.918378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:54593)
0809 08:01:54.918646 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:54.918697 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":81,"threads_started":1}
I20260809 08:01:55.598089 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:55.597658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:56609)
0809 08:01:55.597928 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:55.597989 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":79,"threads_started":1}
I20260809 08:01:55.744685 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:55.744256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:58127)
0809 08:01:55.744535 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:55.744591 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":87,"threads_started":1}
I20260809 08:01:55.919929 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:55.919537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:41395)
0809 08:01:55.919784 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:55.919838 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":73,"threads_started":1}
I20260809 08:01:56.599399 26623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:56.598915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:36773)
0809 08:01:56.599235 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:56.599300 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":123,"threads_started":1}
I20260809 08:01:56.745867 26624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:56.745407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:54101)
0809 08:01:56.745716 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:56.745771 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":91,"threads_started":1}
I20260809 08:01:56.921157 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:56.920766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:43617)
0809 08:01:56.921012 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:56.921067 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":86,"threads_started":1}
I20260809 08:01:57.600807 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:57.600320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:52055)
0809 08:01:57.600639 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:57.600707 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":81,"threads_started":1}
I20260809 08:01:57.747221 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:57.746746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:40357)
0809 08:01:57.747057 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:57.747121 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":78,"threads_started":1}
I20260809 08:01:57.922463 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:57.922058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:51253)
0809 08:01:57.922314 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:57.922371 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":88,"threads_started":1}
I20260809 08:01:58.602149 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:58.601733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:54481)
0809 08:01:58.601981 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:58.602040 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":74,"threads_started":1}
I20260809 08:01:58.717011 26630 raft_consensus.cc:482] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:01:58.717146 26630 raft_consensus.cc:504] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa336cbf4b094e3cb7a45eccd3b64b0d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 33319 } } peers { permanent_uuid: "bee259213e5540f5b1f4b72f9d4e49d7" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 44279 } } peers { permanent_uuid: "f833fb1e31e24d6797480ce9edeb34a0" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34847 } }
I20260809 08:01:58.717666 26630 leader_election.cc:288] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319), bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279)
W20260809 08:01:58.718452 26191 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aa336cbf4b094e3cb7a45eccd3b64b0d (127.8.51.66:33319): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
W20260809 08:01:58.718557 26190 leader_election.cc:341] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bee259213e5540f5b1f4b72f9d4e49d7 (127.8.51.67:44279): Not found: Tablet not found: adc12be3793844b688331e30e9a3c099
I20260809 08:01:58.718660 26190 leader_election.cc:302] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f833fb1e31e24d6797480ce9edeb34a0; no voters: aa336cbf4b094e3cb7a45eccd3b64b0d, bee259213e5540f5b1f4b72f9d4e49d7
I20260809 08:01:58.718837 26630 raft_consensus.cc:2726] T adc12be3793844b688331e30e9a3c099 P f833fb1e31e24d6797480ce9edeb34a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 08:01:58.748416 26631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:58.747965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:47919)
0809 08:01:58.748246 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:58.748320 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":77,"threads_started":1}
I20260809 08:01:58.923723 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:58.923301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:53619)
0809 08:01:58.923567 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:58.923628 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":94,"threads_started":1}
I20260809 08:01:59.603367 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:59.602929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:38593)
0809 08:01:59.603192 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:59.603267 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
I20260809 08:01:59.749559 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:59.749155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:32775)
0809 08:01:59.749408 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:59.749461 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
I20260809 08:01:59.925058 26636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:01:59.924609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:47437)
0809 08:01:59.924888 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 08:01:59.924944 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":92,"threads_started":1}
I20260809 08:02:00.604676 26637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:00.604254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:39319)
0809 08:02:00.604518 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:00.604577 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":79,"threads_started":1}
I20260809 08:02:00.750888 26638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:00.750366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:40283)
0809 08:02:00.750699 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:00.750759 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":163,"threads_started":1}
I20260809 08:02:00.926347 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:00.925962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:43735)
0809 08:02:00.926202 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:00.926256 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260809 08:02:01.605933 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:01.605390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:45581)
0809 08:02:01.605777 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:01.605837 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":88,"threads_started":1}
I20260809 08:02:01.752310 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:01.751832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:39517)
0809 08:02:01.752118 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:01.752207 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":97,"threads_started":1}
I20260809 08:02:01.927522 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:01.927116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:58623)
0809 08:02:01.927375 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:01.927431 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":91,"threads_started":1}
I20260809 08:02:02.607738 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:02.607123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.65:47291)
0809 08:02:02.607462 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:02.607589 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":112,"threads_started":1}
I20260809 08:02:02.753481 26645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:02.753088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.66:34559)
0809 08:02:02.753336 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:02.753389 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260809 08:02:02.922850 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26133
I20260809 08:02:02.928968 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:02.928414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:35581 (local address 127.8.51.67:60405)
0809 08:02:02.928733 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:02.928822 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.126:35581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":70,"threads_started":1}
I20260809 08:02:02.930912 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26312
I20260809 08:02:02.937340 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26451
2026-08-09T08:02:02Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59393 ms)
[----------] 30 tests from SecurityITest (240932 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:03 dist-test-slave-njxd krb5kdc[26649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:03 dist-test-slave-njxd krb5kdc[26649](info): set up 2 sockets
Aug 09 08:02:03 dist-test-slave-njxd krb5kdc[26649](info): commencing operation
krb5kdc: starting...
W20260809 08:02:04.007686 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:04.128329 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:37553
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:37553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:04.235816 26663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:04.236114 26663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:04.236198 26663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:04.240264 26663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:04.240351 26663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:04.240391 26663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:04.240430 26663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:04.240460 26663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:04.245599 26663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:37553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:37553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:04.246610 26663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:04.247624 26663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:04.256310 26668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:04.256385 26663 server_base.cc:1034] running on GCE node
W20260809 08:02:04.256295 26671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.256285 26669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:04.257198 26663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:04.258282 26663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:04.259441 26663 hybrid_clock.cc:648] HybridClock initialized: now 1786262524259423 us; error 32 us; skew 500 ppm
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:04.262176 26663 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:04.263034 26663 webserver.cc:460] Webserver started at http://127.8.51.126:43411/ using document root <none> and password file <none>
I20260809 08:02:04.263545 26663 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:04.263607 26663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:04.263850 26663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:04.265959 26663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "a04d2d2cc2004ce280e4c40da7c44c6e"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "86f9c78fe88903ff596fba04ed1c5d17"
server_key_iv: "b5eb9db8704edc64e6c1b87f17f72b81"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.266487 26663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "a04d2d2cc2004ce280e4c40da7c44c6e"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "86f9c78fe88903ff596fba04ed1c5d17"
server_key_iv: "b5eb9db8704edc64e6c1b87f17f72b81"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.270041 26663 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:04.272310 26678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.273428 26663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:04.273556 26663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "a04d2d2cc2004ce280e4c40da7c44c6e"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "86f9c78fe88903ff596fba04ed1c5d17"
server_key_iv: "b5eb9db8704edc64e6c1b87f17f72b81"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.273681 26663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:04.296463 26663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:04.299451 26663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:04.299674 26663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:04.307269 26663 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:37553
I20260809 08:02:04.307297 26731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:37553 every 8 connection(s)
I20260809 08:02:04.308271 26663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:04.311041 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:04.314685 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26663
I20260809 08:02:04.314800 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:04.315099 8397 external_mini_cluster.cc:1428] Setting key acd3eda5c2a329d57345902ec736773d
I20260809 08:02:04.317163 26732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: Bootstrap starting.
I20260809 08:02:04.319433 26732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:04.320171 26732 log.cc:824] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:04.322196 26732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: No bootstrap required, opened a new log
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:04.326475 26732 raft_consensus.cc:348] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } }
I20260809 08:02:04.326689 26732 raft_consensus.cc:374] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:04.326747 26732 raft_consensus.cc:729] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04d2d2cc2004ce280e4c40da7c44c6e, State: Initialized, Role: FOLLOWER
I20260809 08:02:04.327252 26732 consensus_queue.cc:260] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } }
I20260809 08:02:04.327401 26732 raft_consensus.cc:388] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:04.327481 26732 raft_consensus.cc:482] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:04.327594 26732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:04.328642 26732 raft_consensus.cc:504] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } }
I20260809 08:02:04.329013 26732 leader_election.cc:302] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a04d2d2cc2004ce280e4c40da7c44c6e; no voters:
I20260809 08:02:04.329336 26732 leader_election.cc:288] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:04.329439 26737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:04.329690 26737 raft_consensus.cc:686] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [term 1 LEADER]: Becoming Leader. State: Replica: a04d2d2cc2004ce280e4c40da7c44c6e, State: Running, Role: LEADER
I20260809 08:02:04.329918 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.316570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53600 (local address 127.8.51.126:37553)
0809 08:02:04.317017 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:04.317033 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:04.317078 (+ 45us) server_negotiation.cc:407] Connection header received
0809 08:02:04.317822 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:04.317842 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:04.318184 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:04.318522 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:04.319386 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.320499 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.321402 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.321947 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.322136 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:04.324876 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:04.324889 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:04.324910 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:04.324937 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:04.326722 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.327185 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.327193 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.327203 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.327314 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.327696 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.327699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.327701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.328101 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:04.328274 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:04.328599 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 08:02:04.328905 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":125,"threads_started":1}
I20260809 08:02:04.330224 26737 consensus_queue.cc:237] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } }
I20260809 08:02:04.330693 26732 sys_catalog.cc:564] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:04.331899 26738 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } } }
I20260809 08:02:04.332110 26738 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:04.333163 26752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:04.333146 26739 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a04d2d2cc2004ce280e4c40da7c44c6e. Latest consensus state: current_term: 1 leader_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04d2d2cc2004ce280e4c40da7c44c6e" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37553 } } }
I20260809 08:02:04.333839 26739 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:04.336216 26752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:04.341058 26752 catalog_manager.cc:1347] Generated new cluster ID: bf0b5b2c92d645158fdf9125286e8a2a
I20260809 08:02:04.341120 26752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:04.345690 26752 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:04.346490 26752 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:04.352352 26752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: Generated new TSK 0
I20260809 08:02:04.352963 26752 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:02:04.386776 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:04.496601 26760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:04.496871 26760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:04.496949 26760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:04.500952 26760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:04.501026 26760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:04.501114 26760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:04.506151 26760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:04.507171 26760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:04.508212 26760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:04.517362 26770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.517362 26767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.517364 26768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:04.517560 26760 server_base.cc:1034] running on GCE node
I20260809 08:02:04.518190 26760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:04.518872 26760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:04.520031 26760 hybrid_clock.cc:648] HybridClock initialized: now 1786262524520012 us; error 30 us; skew 500 ppm
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:04.522836 26760 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:02:04.523698 26760 webserver.cc:460] Webserver started at http://127.8.51.65:34117/ using document root <none> and password file <none>
I20260809 08:02:04.524276 26760 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:04.524338 26760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:04.524591 26760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:04.526710 26760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "eedf844ef3bd68961503bf465177fe4b"
server_key_iv: "0df6538f8aaf7f560e1428122e46a681"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.527324 26760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "eedf844ef3bd68961503bf465177fe4b"
server_key_iv: "0df6538f8aaf7f560e1428122e46a681"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.531683 26760 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:02:04.534277 26777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.535480 26760 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:04.535604 26760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "eedf844ef3bd68961503bf465177fe4b"
server_key_iv: "0df6538f8aaf7f560e1428122e46a681"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.535708 26760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:04.557736 26760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:04.560611 26760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:04.560820 26760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:04.561390 26760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:04.562244 26760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:04.562287 26760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.562351 26760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:04.562381 26760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.571147 26760 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:37883
I20260809 08:02:04.571177 26894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:37883 every 8 connection(s)
I20260809 08:02:04.571985 26760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:04.573367 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26760
I20260809 08:02:04.573496 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:04.573869 8397 external_mini_cluster.cc:1428] Setting key c4f5ae64d99742bc3f29956c7b5dd461
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:02:04.586387 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.573925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:40031 (local address 127.8.51.126:37553)
0809 08:02:04.574380 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:04.574385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:04.575104 (+ 719us) server_negotiation.cc:407] Connection header received
0809 08:02:04.576585 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:04.576589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:04.576639 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:04.576712 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:04.578181 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.578716 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.579867 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.580109 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.580223 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:04.582662 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:04.582665 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:04.582668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:04.582705 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:04.584198 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.584696 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.584700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.584702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.584786 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.585169 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.585174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.585176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.585358 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:04.585468 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:04.586012 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 08:02:04.586176 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
I20260809 08:02:04.587168 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.574436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:37553 (local address 127.8.51.65:40031)
0809 08:02:04.574961 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:04.575014 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:04.576290 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:04.576884 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:04.576895 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:04.577417 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:04.578038 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:04.578052 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.578845 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.578848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:04.579741 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:04.579750 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.580258 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.580263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:04.580445 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:04.581030 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:04.581045 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:04.582508 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:04.584310 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:04.584316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:04.584330 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:04.584580 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:04.584879 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:04.584883 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:04.584885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:04.585067 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:04.585466 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:04.585473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:04.585777 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 08:02:04.585958 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 08:02:04.586277 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":131,"threads_started":1}
I20260809 08:02:04.589604 26895 heartbeater.cc:347] Connected to a master server at 127.8.51.126:37553
I20260809 08:02:04.589821 26895 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:04.590248 26895 heartbeater.cc:511] Master 127.8.51.126:37553 requested a full tablet report, sending...
I20260809 08:02:04.591647 26695 ts_manager.cc:194] Registered new tserver with Master: cdc1fdb098ab4e5eb2fb82ac82437fa2 (127.8.51.65:37883)
I20260809 08:02:04.593297 26695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:40031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:02:04.602913 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:04.714581 26901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:04.714859 26901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:04.714936 26901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:04.718928 26901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:04.719007 26901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:04.719095 26901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:04.724225 26901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:04.725212 26901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:04.726239 26901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:04.735697 26906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.735714 26909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.735718 26907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:04.735750 26901 server_base.cc:1034] running on GCE node
I20260809 08:02:04.736331 26901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:04.736912 26901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:04.738086 26901 hybrid_clock.cc:648] HybridClock initialized: now 1786262524738056 us; error 42 us; skew 500 ppm
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:04.740900 26901 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:02:04.741739 26901 webserver.cc:460] Webserver started at http://127.8.51.66:43863/ using document root <none> and password file <none>
I20260809 08:02:04.742276 26901 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:04.742363 26901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:04.742583 26901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:04.744510 26901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "c87eb8799e654714b67a0154c457bb75"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "66157984f34ee64ba46e4bb8f420ea60"
server_key_iv: "fb7843d1280dc7e9847ededd2c17a11b"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.745086 26901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "c87eb8799e654714b67a0154c457bb75"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "66157984f34ee64ba46e4bb8f420ea60"
server_key_iv: "fb7843d1280dc7e9847ededd2c17a11b"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.749080 26901 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 08:02:04.752301 26916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.753535 26901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:02:04.753698 26901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "c87eb8799e654714b67a0154c457bb75"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "66157984f34ee64ba46e4bb8f420ea60"
server_key_iv: "fb7843d1280dc7e9847ededd2c17a11b"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.753814 26901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:04.769775 26901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:04.772553 26901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:04.772751 26901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:04.773265 26901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:04.774106 26901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:04.774176 26901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.774268 26901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:04.774318 26901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.783403 26901 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:41687
I20260809 08:02:04.783433 27032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:41687 every 8 connection(s)
I20260809 08:02:04.784236 26901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:04.789193 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 26901
I20260809 08:02:04.789331 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:04.789710 8397 external_mini_cluster.cc:1428] Setting key 4c3f53aed964cc618e446192de0ac04a
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:04.797936 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.785927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:36391 (local address 127.8.51.126:37553)
0809 08:02:04.786038 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:04.786042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:04.786889 (+ 847us) server_negotiation.cc:407] Connection header received
0809 08:02:04.787793 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:04.787797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:04.787854 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:04.787934 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:04.789027 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.789741 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.791035 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.791336 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.791448 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:04.794178 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:04.794181 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:04.794183 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:04.794205 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:04.795618 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.796285 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.796289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.796290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.796377 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:04.796761 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:04.796763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:04.796764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:04.796923 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:04.796997 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:04.797719 (+ 722us) server_negotiation.cc:299] Negotiation successful
0809 08:02:04.797818 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 08:02:04.799155 27035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.786296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:37553 (local address 127.8.51.66:36391)
0809 08:02:04.786747 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:04.786789 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:04.787586 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:04.788095 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:04.788102 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:04.788435 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:04.788884 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:04.788896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.789899 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.789902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:04.790887 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:04.790897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:04.791484 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:04.791487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:04.791624 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:04.792196 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:04.792211 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:04.794013 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:04.795752 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:04.795761 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:04.795781 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:04.796165 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:04.796469 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:04.796474 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:04.796477 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:04.796656 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:04.797032 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:04.797041 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:04.797372 (+ 331us) client_negotiation.cc:769] Sending connection context
0809 08:02:04.797665 (+ 293us) client_negotiation.cc:240] Negotiation successful
0809 08:02:04.798064 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":113,"threads_started":1}
I20260809 08:02:04.800374 27033 heartbeater.cc:347] Connected to a master server at 127.8.51.126:37553
I20260809 08:02:04.800626 27033 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:02:04.801131 27033 heartbeater.cc:511] Master 127.8.51.126:37553 requested a full tablet report, sending...
I20260809 08:02:04.802205 26695 ts_manager.cc:194] Registered new tserver with Master: c87eb8799e654714b67a0154c457bb75 (127.8.51.66:41687)
I20260809 08:02:04.802783 26695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:36391
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:02:04.819886 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:38309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:04.928608 27038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:04.928920 27038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:04.928999 27038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:04.933353 27038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:04.933434 27038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:04.933524 27038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:04.938712 27038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:38309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:04.939823 27038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:04.940912 27038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:04.950454 27046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.950385 27048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:04.950385 27044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:04.950747 27038 server_base.cc:1034] running on GCE node
I20260809 08:02:04.951133 27038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:04.951762 27038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:04.952917 27038 hybrid_clock.cc:648] HybridClock initialized: now 1786262524952903 us; error 26 us; skew 500 ppm
Aug 09 08:02:04 dist-test-slave-njxd krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:04.955646 27038 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:02:04.956606 27038 webserver.cc:460] Webserver started at http://127.8.51.67:35403/ using document root <none> and password file <none>
I20260809 08:02:04.957219 27038 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:04.957283 27038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:04.957505 27038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:04.959620 27038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "3bfed63465a24be98c0e0da6e3662b88"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "5aadf0e4fecf524af777ad954932b640"
server_key_iv: "15292792f769dc40b4caf33ddfae603e"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.960258 27038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "3bfed63465a24be98c0e0da6e3662b88"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "5aadf0e4fecf524af777ad954932b640"
server_key_iv: "15292792f769dc40b4caf33ddfae603e"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.963932 27038 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 08:02:04.966378 27055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.967525 27038 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:04.967677 27038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "3bfed63465a24be98c0e0da6e3662b88"
format_stamp: "Formatted at 2026-08-09 08:02:04 on dist-test-slave-njxd"
server_key: "5aadf0e4fecf524af777ad954932b640"
server_key_iv: "15292792f769dc40b4caf33ddfae603e"
server_key_version: "encryptionkey@0"
I20260809 08:02:04.967784 27038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:04.979405 27038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:04.982076 27038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:04.982278 27038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:04.982815 27038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:04.983582 27038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:04.983661 27038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.983731 27038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:04.983776 27038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:04.992813 27038 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:43223
I20260809 08:02:04.992839 27173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:43223 every 8 connection(s)
I20260809 08:02:04.993702 27038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:02:04.996256 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27038
I20260809 08:02:04.996379 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:04.996716 8397 external_mini_cluster.cc:1428] Setting key 7087daced4e57860dd5d87bf63189c6a
Aug 09 08:02:05 dist-test-slave-njxd krb5kdc[26649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262524, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:05.007395 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.995431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:40549 (local address 127.8.51.126:37553)
0809 08:02:04.995574 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:04.995579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:04.997119 (+ 1540us) server_negotiation.cc:407] Connection header received
0809 08:02:04.998122 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:04.998126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:04.998181 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:04.998269 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:04.999502 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.000043 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.001181 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.001409 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.001523 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.003951 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:05.003955 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:05.003958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:05.003991 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:05.005298 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:05.005871 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:05.005875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:05.005877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:05.005960 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:05.006304 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:05.006307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:05.006309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:05.006480 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:05.006589 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.007101 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.007225 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:05.008179 27176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:04.995846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:37553 (local address 127.8.51.67:40549)
0809 08:02:04.996943 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:04.996999 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:04.997916 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:04.998452 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:04.998458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:04.998905 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:04.999357 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:04.999370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.000182 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.000191 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.001048 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.001057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.001559 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.001563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.001758 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.002364 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:05.002381 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:05.003786 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:05.005416 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:05.005421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:05.005435 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:05.005759 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:05.006056 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:05.006060 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:05.006062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:05.006200 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:05.006594 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:05.006603 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:05.006831 (+ 228us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.007006 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.007336 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"thread_start_us":108,"threads_started":1}
I20260809 08:02:05.009275 27174 heartbeater.cc:347] Connected to a master server at 127.8.51.126:37553
I20260809 08:02:05.009509 27174 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:05.010082 27174 heartbeater.cc:511] Master 127.8.51.126:37553 requested a full tablet report, sending...
I20260809 08:02:05.011099 26695 ts_manager.cc:194] Registered new tserver with Master: 3bfed63465a24be98c0e0da6e3662b88 (127.8.51.67:43223)
I20260809 08:02:05.011653 26695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:40549
I20260809 08:02:05.028710 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:05.041240 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.031292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53604 (local address 127.8.51.126:37553)
0809 08:02:05.031444 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.031451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.031951 (+ 500us) server_negotiation.cc:407] Connection header received
0809 08:02:05.032089 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.032096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.032153 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.032233 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:05.033085 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.033719 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.034989 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.035336 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.035432 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.036919 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:05.036924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:05.036929 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:05.036959 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:05.038917 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:05.039578 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:05.039583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:05.039585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:05.039684 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:05.040029 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:05.040032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:05.040034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:05.040349 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:05.040489 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.040817 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.040970 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:05.044816 26695 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:05.048333 26695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:05.066735 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.060151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36014 (local address 127.8.51.65:37883)
0809 08:02:05.060662 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.060683 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.060944 (+ 261us) server_negotiation.cc:407] Connection header received
0809 08:02:05.061182 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.061190 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.061398 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.061518 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:05.061971 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.063120 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.064945 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.065815 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.065892 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066028 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.066457 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.066562 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":113,"threads_started":1}
I20260809 08:02:05.066840 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.058551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.8.51.67:43223)
0809 08:02:05.059390 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.059403 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.059431 (+ 28us) server_negotiation.cc:407] Connection header received
0809 08:02:05.060103 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.060111 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.060368 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.060539 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:05.061284 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.062661 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.064772 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.065825 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.065916 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066078 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.066509 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.066625 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":79,"threads_started":1}
I20260809 08:02:05.067317 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.058564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:41687 (local address 127.0.0.1:38538)
0809 08:02:05.059964 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.059978 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.060137 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.060908 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.060913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.060936 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:05.061150 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.061159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.063412 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.063415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.064800 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.064810 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.066805 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.066808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.066907 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066925 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.066983 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.067116 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1336,"mutex_wait_us":146,"thread_start_us":88,"threads_started":1}
I20260809 08:02:05.067344 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.058429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:43223 (local address 127.0.0.1:49856)
0809 08:02:05.058988 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.059051 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.059844 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.060834 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.060842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.060872 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:05.061130 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.061141 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.062870 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.062874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.064595 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.064610 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.066191 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.066196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.066325 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066358 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.067031 (+ 673us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.067142 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":72,"thread_start_us":74,"threads_started":1}
I20260809 08:02:05.067786 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.059291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38538 (local address 127.8.51.66:41687)
0809 08:02:05.059659 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.059671 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.060061 (+ 390us) server_negotiation.cc:407] Connection header received
0809 08:02:05.060319 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.060325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.060552 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.060697 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:05.061270 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.063271 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.064945 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.066503 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.066572 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066702 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.067516 (+ 814us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.067625 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":119,"threads_started":1}
I20260809 08:02:05.068250 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.059702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:37883 (local address 127.0.0.1:36014)
0809 08:02:05.060859 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.060873 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.061018 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.061729 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.061732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.061750 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:05.061838 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.061843 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.063294 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.063298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.064798 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.064810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.066139 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.066143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.066246 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.066283 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.067297 (+ 1014us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.068126 (+ 829us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"mutex_wait_us":163,"thread_start_us":118,"threads_started":1}
I20260809 08:02:05.071158 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb45368b5634487ac10c9e928532e14 (DEFAULT_TABLE table=test-table [id=40ae4c7c9f8e4b738031fc5911496417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:05.071158 26826 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb45368b5634487ac10c9e928532e14 (DEFAULT_TABLE table=test-table [id=40ae4c7c9f8e4b738031fc5911496417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:05.071604 27106 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb45368b5634487ac10c9e928532e14 (DEFAULT_TABLE table=test-table [id=40ae4c7c9f8e4b738031fc5911496417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:05.072304 26826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb45368b5634487ac10c9e928532e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:05.072304 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb45368b5634487ac10c9e928532e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:05.072719 27106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb45368b5634487ac10c9e928532e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:05.079773 27192 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: Bootstrap starting.
I20260809 08:02:05.081743 27193 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Bootstrap starting.
I20260809 08:02:05.082211 27191 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Bootstrap starting.
I20260809 08:02:05.082860 27192 tablet_bootstrap.cc:654] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:05.084203 27193 tablet_bootstrap.cc:654] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:05.085719 27191 tablet_bootstrap.cc:654] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:05.085861 27193 log.cc:824] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:05.086584 27191 log.cc:824] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:05.088148 27192 log.cc:824] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:05.088204 27193 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: No bootstrap required, opened a new log
I20260809 08:02:05.088392 27193 ts_tablet_manager.cc:1397] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 08:02:05.088555 27191 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: No bootstrap required, opened a new log
I20260809 08:02:05.088740 27191 ts_tablet_manager.cc:1397] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 08:02:05.090049 27192 tablet_bootstrap.cc:492] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: No bootstrap required, opened a new log
I20260809 08:02:05.090250 27192 ts_tablet_manager.cc:1397] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260809 08:02:05.092384 27193 raft_consensus.cc:348] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.092384 27191 raft_consensus.cc:348] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.092649 27191 raft_consensus.cc:374] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:05.092649 27193 raft_consensus.cc:374] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:05.092701 27191 raft_consensus.cc:729] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87eb8799e654714b67a0154c457bb75, State: Initialized, Role: FOLLOWER
I20260809 08:02:05.092716 27193 raft_consensus.cc:729] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfed63465a24be98c0e0da6e3662b88, State: Initialized, Role: FOLLOWER
I20260809 08:02:05.093201 27191 consensus_queue.cc:260] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.093192 27193 consensus_queue.cc:260] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.093873 27174 heartbeater.cc:503] Master 127.8.51.126:37553 was elected leader, sending a full tablet report...
I20260809 08:02:05.094247 27191 ts_tablet_manager.cc:1428] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 08:02:05.094247 27193 ts_tablet_manager.cc:1428] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:02:05.094632 27033 heartbeater.cc:503] Master 127.8.51.126:37553 was elected leader, sending a full tablet report...
I20260809 08:02:05.095743 27192 raft_consensus.cc:348] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.096026 27192 raft_consensus.cc:374] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:05.096098 27192 raft_consensus.cc:729] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdc1fdb098ab4e5eb2fb82ac82437fa2, State: Initialized, Role: FOLLOWER
I20260809 08:02:05.096625 27192 consensus_queue.cc:260] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.097715 27192 ts_tablet_manager.cc:1428] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 08:02:05.098052 26895 heartbeater.cc:503] Master 127.8.51.126:37553 was elected leader, sending a full tablet report...
I20260809 08:02:05.169413 27200 raft_consensus.cc:482] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:02:05.169715 27200 raft_consensus.cc:504] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.171401 27200 leader_election.cc:288] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bfed63465a24be98c0e0da6e3662b88 (127.8.51.67:43223), c87eb8799e654714b67a0154c457bb75 (127.8.51.66:41687)
I20260809 08:02:05.176139 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.171849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:57233 (local address 127.8.51.67:43223)
0809 08:02:05.172062 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.172070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.172140 (+ 70us) server_negotiation.cc:407] Connection header received
0809 08:02:05.172429 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.172435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.172508 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.172615 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:05.173147 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.173894 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.175125 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.175540 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.175688 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.175752 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.175944 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.176017 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 08:02:05.176168 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.171623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:43223 (local address 127.8.51.65:57233)
0809 08:02:05.172035 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.172053 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.172230 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.172763 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.172768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.172794 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:05.172976 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.172985 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.174020 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.174023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.174986 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.174996 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.175709 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.175712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.175813 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.175839 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.175928 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.175996 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":72,"thread_start_us":119,"threads_started":1}
I20260809 08:02:05.176887 27127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb45368b5634487ac10c9e928532e14" candidate_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfed63465a24be98c0e0da6e3662b88" is_pre_election: true
I20260809 08:02:05.177261 27127 raft_consensus.cc:2454] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdc1fdb098ab4e5eb2fb82ac82437fa2 in term 0.
I20260809 08:02:05.177435 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.171623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:41687 (local address 127.8.51.65:50943)
0809 08:02:05.172372 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.172387 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.172503 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.172750 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.172753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.172769 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:05.172924 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.172930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.174002 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.174008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.175638 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.175652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.177003 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.177007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.177115 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.177138 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.177216 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.177287 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":409,"spinlock_wait_cycles":16256,"thread_start_us":100,"threads_started":1}
I20260809 08:02:05.177721 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.171835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:50943 (local address 127.8.51.66:41687)
0809 08:02:05.172202 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.172206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.172471 (+ 265us) server_negotiation.cc:407] Connection header received
0809 08:02:05.172596 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.172604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.172645 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.172726 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:05.173038 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.173864 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.175807 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.176787 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.176886 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.176971 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.177257 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.177443 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260809 08:02:05.177894 26780 leader_election.cc:302] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfed63465a24be98c0e0da6e3662b88, cdc1fdb098ab4e5eb2fb82ac82437fa2; no voters:
I20260809 08:02:05.178175 27200 raft_consensus.cc:2781] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:05.178301 27200 raft_consensus.cc:482] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:05.178364 27200 raft_consensus.cc:3037] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:05.178333 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb45368b5634487ac10c9e928532e14" candidate_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87eb8799e654714b67a0154c457bb75" is_pre_election: true
I20260809 08:02:05.178558 26985 raft_consensus.cc:2454] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdc1fdb098ab4e5eb2fb82ac82437fa2 in term 0.
I20260809 08:02:05.180003 27200 raft_consensus.cc:504] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.180474 27200 leader_election.cc:288] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [CANDIDATE]: Term 1 election: Requested vote from peers 3bfed63465a24be98c0e0da6e3662b88 (127.8.51.67:43223), c87eb8799e654714b67a0154c457bb75 (127.8.51.66:41687)
I20260809 08:02:05.180766 27127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb45368b5634487ac10c9e928532e14" candidate_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfed63465a24be98c0e0da6e3662b88"
I20260809 08:02:05.180757 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb45368b5634487ac10c9e928532e14" candidate_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87eb8799e654714b67a0154c457bb75"
I20260809 08:02:05.180891 27127 raft_consensus.cc:3037] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:05.180891 26985 raft_consensus.cc:3037] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:05.182216 26985 raft_consensus.cc:2454] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdc1fdb098ab4e5eb2fb82ac82437fa2 in term 1.
I20260809 08:02:05.182216 27127 raft_consensus.cc:2454] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdc1fdb098ab4e5eb2fb82ac82437fa2 in term 1.
I20260809 08:02:05.182540 26780 leader_election.cc:302] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfed63465a24be98c0e0da6e3662b88, cdc1fdb098ab4e5eb2fb82ac82437fa2; no voters:
I20260809 08:02:05.182708 27200 raft_consensus.cc:2781] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:05.182967 27200 raft_consensus.cc:686] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [term 1 LEADER]: Becoming Leader. State: Replica: cdc1fdb098ab4e5eb2fb82ac82437fa2, State: Running, Role: LEADER
I20260809 08:02:05.183300 27200 consensus_queue.cc:237] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } }
I20260809 08:02:05.186653 26694 catalog_manager.cc:5495] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdc1fdb098ab4e5eb2fb82ac82437fa2 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdc1fdb098ab4e5eb2fb82ac82437fa2" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 37883 } health_report { overall_health: HEALTHY } } }
I20260809 08:02:05.222651 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.218824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36026 (local address 127.8.51.65:37883)
0809 08:02:05.218983 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.218988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.219015 (+ 27us) server_negotiation.cc:407] Connection header received
0809 08:02:05.219252 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.219254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.219313 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.219429 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:05.219699 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.220213 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.221084 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.221313 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.221431 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.221821 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:05.222252 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:05.222394 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.222434 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.222491 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 08:02:05.228709 26985 raft_consensus.cc:1261] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 1 FOLLOWER]: Refusing update from remote peer cdc1fdb098ab4e5eb2fb82ac82437fa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:05.228964 27127 raft_consensus.cc:1261] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 1 FOLLOWER]: Refusing update from remote peer cdc1fdb098ab4e5eb2fb82ac82437fa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:05.229828 27203 consensus_queue.cc:1035] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87eb8799e654714b67a0154c457bb75" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 41687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:05.230026 27200 consensus_queue.cc:1035] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfed63465a24be98c0e0da6e3662b88" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:05.238265 27206 mvcc.cc:205] Tried to move back new op lower bound from 7316531303329374208 to 7316531303154528256. Current Snapshot: MvccSnapshot[applied={T|T < 7316531303329374208}]
I20260809 08:02:05.239564 27208 mvcc.cc:205] Tried to move back new op lower bound from 7316531303329374208 to 7316531303154528256. Current Snapshot: MvccSnapshot[applied={T|T < 7316531303329374208}]
I20260809 08:02:05.246470 27207 mvcc.cc:205] Tried to move back new op lower bound from 7316531303329374208 to 7316531303154528256. Current Snapshot: MvccSnapshot[applied={T|T < 7316531303329374208 or (T in {7316531303329374208})}]
I20260809 08:02:05.247747 26694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:05.247910 26694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:05.250192 26694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a04d2d2cc2004ce280e4c40da7c44c6e: Sending DeleteTablet for 3 replicas of tablet 9cb45368b5634487ac10c9e928532e14
I20260809 08:02:05.250946 26826 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb45368b5634487ac10c9e928532e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:36014
I20260809 08:02:05.251029 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb45368b5634487ac10c9e928532e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:38538
I20260809 08:02:05.251652 27106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb45368b5634487ac10c9e928532e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:05 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:49856
I20260809 08:02:05.252135 27216 tablet_replica.cc:330] T 9cb45368b5634487ac10c9e928532e14 P cdc1fdb098ab4e5eb2fb82ac82437fa2: stopping tablet replica
I20260809 08:02:05.252210 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26760
I20260809 08:02:05.254895 27215 tablet_replica.cc:330] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: stopping tablet replica
I20260809 08:02:05.255201 27215 raft_consensus.cc:2229] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:05.255501 27215 raft_consensus.cc:2258] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:05.256853 27215 ts_tablet_manager.cc:1905] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:05.257840 27217 tablet_replica.cc:330] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: stopping tablet replica
I20260809 08:02:05.258242 27217 raft_consensus.cc:2229] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:05.258672 27217 raft_consensus.cc:2258] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:05.259784 27215 ts_tablet_manager.cc:1918] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:05.259929 27215 log.cc:1196] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/9cb45368b5634487ac10c9e928532e14
I20260809 08:02:05.260128 27217 ts_tablet_manager.cc:1905] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:05.260376 27215 ts_tablet_manager.cc:1939] T 9cb45368b5634487ac10c9e928532e14 P c87eb8799e654714b67a0154c457bb75: Deleting consensus metadata
I20260809 08:02:05.261700 26680 catalog_manager.cc:4841] TS c87eb8799e654714b67a0154c457bb75 (127.8.51.66:41687): tablet 9cb45368b5634487ac10c9e928532e14 (table test-table [id=40ae4c7c9f8e4b738031fc5911496417]) successfully deleted
I20260809 08:02:05.263242 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26901
W20260809 08:02:05.263300 26681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:37883 (error 108)
I20260809 08:02:05.262730 27217 ts_tablet_manager.cc:1918] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:05.263919 27217 log.cc:1196] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/9cb45368b5634487ac10c9e928532e14
I20260809 08:02:05.264302 27217 ts_tablet_manager.cc:1939] T 9cb45368b5634487ac10c9e928532e14 P 3bfed63465a24be98c0e0da6e3662b88: Deleting consensus metadata
I20260809 08:02:05.265606 26681 catalog_manager.cc:4841] TS 3bfed63465a24be98c0e0da6e3662b88 (127.8.51.67:43223): tablet 9cb45368b5634487ac10c9e928532e14 (table test-table [id=40ae4c7c9f8e4b738031fc5911496417]) successfully deleted
I20260809 08:02:05.270474 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.270154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:37883 (local address 127.0.0.1:36030)
0809 08:02:05.270278 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.270392 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 08:02:05.270696 26681 catalog_manager.cc:4584] TS cdc1fdb098ab4e5eb2fb82ac82437fa2 (127.8.51.65:37883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9cb45368b5634487ac10c9e928532e14: Network error: Client connection negotiation failed: client connection to 127.8.51.65:37883: connect: Connection refused (error 111)
I20260809 08:02:05.271252 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27038
I20260809 08:02:05.278285 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 26663
2026-08-09T08:02:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2339 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T08:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:05Z Disabled control of system clock
I20260809 08:02:05.309882 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40101
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:33433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:40101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:05.419368 27222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:05.419622 27222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:05.419656 27222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:05.423533 27222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:05.423583 27222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:05.423599 27222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:05.423615 27222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:05.423630 27222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:05.428323 27222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:33433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:40101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:40101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:05.429293 27222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:05.430634 27222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:05.439128 27227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:05.439132 27231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:05.439133 27229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:05.439457 27222 server_base.cc:1034] running on GCE node
I20260809 08:02:05.440052 27222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:05.441166 27222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:05.442332 27222 hybrid_clock.cc:648] HybridClock initialized: now 1786262525442304 us; error 39 us; skew 500 ppm
I20260809 08:02:05.444237 27222 webserver.cc:460] Webserver started at http://127.8.51.126:38493/ using document root <none> and password file <none>
I20260809 08:02:05.444868 27222 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:05.444937 27222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:05.445119 27222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:05.447326 27222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b5a886b05ab74107b7fa5995068bc97a"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "ad7431abe024af13377af91daa011ee9"
server_key_iv: "a07863b128634c3548ec900758421c70"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.447872 27222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b5a886b05ab74107b7fa5995068bc97a"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "ad7431abe024af13377af91daa011ee9"
server_key_iv: "a07863b128634c3548ec900758421c70"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.451601 27222 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:02:05.454020 27237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.455331 27222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:05.455459 27222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b5a886b05ab74107b7fa5995068bc97a"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "ad7431abe024af13377af91daa011ee9"
server_key_iv: "a07863b128634c3548ec900758421c70"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.455567 27222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:05.471768 27222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:05.472434 27222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:05.472642 27222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:05.479836 27222 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:40101
I20260809 08:02:05.479846 27291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:40101 every 8 connection(s)
I20260809 08:02:05.480820 27222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:05.483907 27292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:05.485651 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27222
I20260809 08:02:05.485767 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:05.486057 8397 external_mini_cluster.cc:1428] Setting key 875e1b81ca0e85391d50d337802b34c3
I20260809 08:02:05.489928 27292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: Bootstrap starting.
I20260809 08:02:05.492105 27292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:05.492847 27292 log.cc:824] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:05.494837 27292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: No bootstrap required, opened a new log
I20260809 08:02:05.495602 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.487492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56748 (local address 127.8.51.126:40101)
0809 08:02:05.488146 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.488160 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.488194 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:02:05.489061 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.489083 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.489508 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.489907 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:05.490358 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.491313 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.492249 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.492728 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.492907 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.493847 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:05.493853 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:05.493866 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:05.494259 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:05.494314 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:05.494334 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:05.494448 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.494588 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.494854 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":135,"threads_started":1}
I20260809 08:02:05.498420 27292 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } }
I20260809 08:02:05.498653 27292 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:05.498731 27292 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5a886b05ab74107b7fa5995068bc97a, State: Initialized, Role: FOLLOWER
I20260809 08:02:05.499187 27292 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } }
I20260809 08:02:05.499336 27292 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:05.499423 27292 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:05.499521 27292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:05.500516 27292 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } }
I20260809 08:02:05.500835 27292 leader_election.cc:302] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5a886b05ab74107b7fa5995068bc97a; no voters:
I20260809 08:02:05.501155 27292 leader_election.cc:288] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:05.501223 27297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:05.501505 27297 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [term 1 LEADER]: Becoming Leader. State: Replica: b5a886b05ab74107b7fa5995068bc97a, State: Running, Role: LEADER
I20260809 08:02:05.501847 27297 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } }
I20260809 08:02:05.502416 27292 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:05.502928 27297 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5a886b05ab74107b7fa5995068bc97a. Latest consensus state: current_term: 1 leader_uuid: "b5a886b05ab74107b7fa5995068bc97a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } } }
I20260809 08:02:05.503149 27297 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:05.503363 27298 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5a886b05ab74107b7fa5995068bc97a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a886b05ab74107b7fa5995068bc97a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 40101 } } }
I20260809 08:02:05.503484 27298 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:05.503697 27303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:05.506899 27303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:05.512607 27303 catalog_manager.cc:1347] Generated new cluster ID: b90208b7d3c442d9b48758fbd32ff9f6
I20260809 08:02:05.512681 27303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:05.539867 27303 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:05.540846 27303 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:05.546554 27303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: Generated new TSK 0
I20260809 08:02:05.547300 27303 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:05.559988 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--builtin_ntp_servers=127.8.51.84:33433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:05.687922 27316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:05.688164 27316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:05.688202 27316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:05.692224 27316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:05.692274 27316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:05.692365 27316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:05.696965 27316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:33433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:05.698026 27316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:05.699378 27316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:05.708815 27323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:05.708829 27324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:05.708896 27316 server_base.cc:1034] running on GCE node
W20260809 08:02:05.708825 27326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:05.709429 27316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:05.710085 27316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:05.711247 27316 hybrid_clock.cc:648] HybridClock initialized: now 1786262525711228 us; error 30 us; skew 500 ppm
I20260809 08:02:05.713027 27316 webserver.cc:460] Webserver started at http://127.8.51.65:44395/ using document root <none> and password file <none>
I20260809 08:02:05.713563 27316 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:05.713706 27316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:05.713889 27316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:05.716136 27316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "cf81045f9f4c4221906e8298e8943a22"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "bdfaf96d3ccbc5b85880457c625ce713"
server_key_iv: "e1f61bf9d3a86dacdd76e2f5b9b5a63a"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.716900 27316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "cf81045f9f4c4221906e8298e8943a22"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "bdfaf96d3ccbc5b85880457c625ce713"
server_key_iv: "e1f61bf9d3a86dacdd76e2f5b9b5a63a"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.722398 27316 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 08:02:05.725884 27334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.727329 27316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:02:05.727478 27316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "cf81045f9f4c4221906e8298e8943a22"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "bdfaf96d3ccbc5b85880457c625ce713"
server_key_iv: "e1f61bf9d3a86dacdd76e2f5b9b5a63a"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.727593 27316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:05.748836 27316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:05.749537 27316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:05.749797 27316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:05.750401 27316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:05.751353 27316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:05.751398 27316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.751469 27316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:05.751499 27316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.761626 27316 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:44419
I20260809 08:02:05.761658 27450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:44419 every 8 connection(s)
I20260809 08:02:05.762578 27316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:05.768187 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27316
I20260809 08:02:05.768327 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:05.768611 8397 external_mini_cluster.cc:1428] Setting key 97d0d34716e1ef9272aa6f564876cd39
I20260809 08:02:05.770522 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--builtin_ntp_servers=127.8.51.84:33433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:05.772104 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.764418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:44145 (local address 127.8.51.126:40101)
0809 08:02:05.764577 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.764580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.765698 (+ 1118us) server_negotiation.cc:407] Connection header received
0809 08:02:05.767075 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.767078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.767132 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.767236 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:05.768121 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.768762 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.770169 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.770388 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.770496 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.771622 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:05.771625 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:05.771628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:05.771640 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:05.771667 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:05.771675 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:05.771751 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.771910 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.771968 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 08:02:05.772868 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.764859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40101 (local address 127.8.51.65:44145)
0809 08:02:05.765497 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.765536 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.766873 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.767407 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.767414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.767495 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:05.767982 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.767994 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.768894 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.768897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.770040 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.770052 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.770530 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.770534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.770750 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.771379 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:05.771381 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:05.771418 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:05.771477 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:05.771753 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:05.771765 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:05.771772 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.771897 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.772154 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":117,"threads_started":1}
I20260809 08:02:05.773975 27451 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40101
I20260809 08:02:05.774214 27451 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:05.774712 27451 heartbeater.cc:511] Master 127.8.51.126:40101 requested a full tablet report, sending...
I20260809 08:02:05.776099 27255 ts_manager.cc:194] Registered new tserver with Master: cf81045f9f4c4221906e8298e8943a22 (127.8.51.65:44419)
I20260809 08:02:05.777210 27255 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.65:44145
W20260809 08:02:05.881247 27454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:05.881512 27454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:05.881618 27454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:05.885509 27454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:05.885584 27454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:05.885761 27454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:05.890514 27454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:33433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:05.891590 27454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:05.892958 27454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:05.902182 27460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:05.902293 27459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:05.902230 27462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:05.902855 27454 server_base.cc:1034] running on GCE node
I20260809 08:02:05.903295 27454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:05.903954 27454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:05.905162 27454 hybrid_clock.cc:648] HybridClock initialized: now 1786262525905127 us; error 42 us; skew 500 ppm
I20260809 08:02:05.906965 27454 webserver.cc:460] Webserver started at http://127.8.51.66:45353/ using document root <none> and password file <none>
I20260809 08:02:05.907562 27454 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:05.907635 27454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:05.907814 27454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:05.909893 27454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "cc893b08bcd848ffbcda1af53bd5f79e"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "5cae69c5f34f267271c850cd29f92471"
server_key_iv: "bab4e59eb4f6cf01d05cbe0b7fc16cb4"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.910398 27454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "cc893b08bcd848ffbcda1af53bd5f79e"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "5cae69c5f34f267271c850cd29f92471"
server_key_iv: "bab4e59eb4f6cf01d05cbe0b7fc16cb4"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.913934 27454 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:02:05.916214 27468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.917443 27454 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:05.917564 27454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "cc893b08bcd848ffbcda1af53bd5f79e"
format_stamp: "Formatted at 2026-08-09 08:02:05 on dist-test-slave-njxd"
server_key: "5cae69c5f34f267271c850cd29f92471"
server_key_iv: "bab4e59eb4f6cf01d05cbe0b7fc16cb4"
server_key_version: "encryptionkey@0"
I20260809 08:02:05.917752 27454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:05.929221 27454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:05.929883 27454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:05.930071 27454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:05.930621 27454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:05.931496 27454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:05.931576 27454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.931677 27454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:05.931732 27454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:05.940635 27454 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:39079
I20260809 08:02:05.940657 27587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:39079 every 8 connection(s)
I20260809 08:02:05.941566 27454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:05.948040 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27454
I20260809 08:02:05.948197 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:05.948501 8397 external_mini_cluster.cc:1428] Setting key 768443efd9650c585be27ae703d30e5b
I20260809 08:02:05.950850 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--builtin_ntp_servers=127.8.51.84:33433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:05.950904 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.943356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:33207 (local address 127.8.51.126:40101)
0809 08:02:05.943501 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:05.943505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:05.944570 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 08:02:05.945971 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:05.945974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:05.946022 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:05.946098 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:05.946974 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.947489 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.948749 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.949039 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.949154 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.950409 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:05.950413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:05.950416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:05.950430 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:05.950452 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:05.950462 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:05.950537 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:05.950687 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 08:02:05.950753 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 08:02:05.951733 27590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:05.943738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40101 (local address 127.8.51.66:33207)
0809 08:02:05.944379 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:05.944432 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:05.945775 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:05.946264 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:05.946270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:05.946353 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:05.946847 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.946860 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.947591 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.947593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.948600 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:05.948613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:05.949217 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:05.949224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:05.949446 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:05.950142 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:05.950144 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:05.950198 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:05.950260 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:05.950543 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:05.950550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:05.950554 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 08:02:05.950647 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 08:02:05.950869 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":114,"threads_started":1}
I20260809 08:02:05.952864 27588 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40101
I20260809 08:02:05.953106 27588 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:05.953730 27588 heartbeater.cc:511] Master 127.8.51.126:40101 requested a full tablet report, sending...
I20260809 08:02:05.954829 27255 ts_manager.cc:194] Registered new tserver with Master: cc893b08bcd848ffbcda1af53bd5f79e (127.8.51.66:39079)
I20260809 08:02:05.955391 27255 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.66:33207
W20260809 08:02:06.059930 27591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:06.060213 27591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:06.060284 27591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:06.064440 27591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:06.064520 27591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:06.064603 27591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:06.069458 27591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:33433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:40101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:06.070573 27591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:06.071942 27591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:06.081489 27597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:06.081542 27591 server_base.cc:1034] running on GCE node
W20260809 08:02:06.081522 27599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:06.081501 27596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:06.082129 27591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:06.082788 27591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:06.083956 27591 hybrid_clock.cc:648] HybridClock initialized: now 1786262526083924 us; error 45 us; skew 500 ppm
I20260809 08:02:06.085893 27591 webserver.cc:460] Webserver started at http://127.8.51.67:38175/ using document root <none> and password file <none>
I20260809 08:02:06.086464 27591 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:06.086525 27591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:06.086774 27591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:06.088842 27591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "fe79115a401e4dc89207e0e0f7eef1b8"
format_stamp: "Formatted at 2026-08-09 08:02:06 on dist-test-slave-njxd"
server_key: "f6d37ee2ffa915bedc4cf505fb1d63e1"
server_key_iv: "40ea7b1206302ff19eeb18d058e934fb"
server_key_version: "encryptionkey@0"
I20260809 08:02:06.089409 27591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "fe79115a401e4dc89207e0e0f7eef1b8"
format_stamp: "Formatted at 2026-08-09 08:02:06 on dist-test-slave-njxd"
server_key: "f6d37ee2ffa915bedc4cf505fb1d63e1"
server_key_iv: "40ea7b1206302ff19eeb18d058e934fb"
server_key_version: "encryptionkey@0"
I20260809 08:02:06.092999 27591 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:02:06.095360 27605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:06.096535 27591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 08:02:06.096658 27591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "fe79115a401e4dc89207e0e0f7eef1b8"
format_stamp: "Formatted at 2026-08-09 08:02:06 on dist-test-slave-njxd"
server_key: "f6d37ee2ffa915bedc4cf505fb1d63e1"
server_key_iv: "40ea7b1206302ff19eeb18d058e934fb"
server_key_version: "encryptionkey@0"
I20260809 08:02:06.096755 27591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:06.121766 27591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:06.122468 27591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:06.122666 27591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:06.123296 27591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:06.124228 27591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:06.124271 27591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:06.124338 27591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:06.124394 27591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:06.133452 27725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:38939 every 8 connection(s)
I20260809 08:02:06.133458 27591 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:38939
I20260809 08:02:06.134423 27591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:02:06.138072 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27591
I20260809 08:02:06.138164 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:06.138450 8397 external_mini_cluster.cc:1428] Setting key dcf954c8d5833f94f666df2fd13749cb
I20260809 08:02:06.143505 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.136246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:56549 (local address 127.8.51.126:40101)
0809 08:02:06.136381 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.136385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.137388 (+ 1003us) server_negotiation.cc:407] Connection header received
0809 08:02:06.138885 (+ 1497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.138888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.138972 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.139076 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:06.140158 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.140827 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.141898 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.142100 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.142178 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.143103 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:06.143106 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:06.143108 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:06.143118 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:06.143137 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:06.143144 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:06.143216 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.143354 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.143401 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 08:02:06.144330 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.136635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:40101 (local address 127.8.51.67:56549)
0809 08:02:06.137237 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.137275 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.138651 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.139274 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.139283 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.139403 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:06.140026 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.140044 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.140936 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.140938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.141801 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.141810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.142227 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.142229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.142357 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.142889 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:06.142891 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:06.142925 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:06.142981 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:06.143239 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:06.143245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:06.143249 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.143336 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.143537 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":105,"threads_started":1}
I20260809 08:02:06.145459 27726 heartbeater.cc:347] Connected to a master server at 127.8.51.126:40101
I20260809 08:02:06.145707 27726 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:06.146235 27726 heartbeater.cc:511] Master 127.8.51.126:40101 requested a full tablet report, sending...
I20260809 08:02:06.147197 27255 ts_manager.cc:194] Registered new tserver with Master: fe79115a401e4dc89207e0e0f7eef1b8 (127.8.51.67:38939)
I20260809 08:02:06.147754 27255 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.67:56549
I20260809 08:02:06.152043 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:06.157394 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.154093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56764 (local address 127.8.51.126:40101)
0809 08:02:06.154236 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.154243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.154382 (+ 139us) server_negotiation.cc:407] Connection header received
0809 08:02:06.154462 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.154464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.154500 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.154572 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:06.154768 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.155286 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.156075 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.156277 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.156349 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.157020 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:06.157023 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:06.157025 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:06.157036 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:06.157053 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:06.157061 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:06.157116 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.157189 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.157233 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 08:02:06.160074 27255 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:06.163132 27255 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:06.176816 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.170986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.8.51.65:44419)
0809 08:02:06.171764 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.171782 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.171806 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:02:06.171894 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.171899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.172087 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.172765 (+ 678us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:06.172897 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173913 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.175312 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.176118 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.176232 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.176428 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.176563 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.176659 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":119,"threads_started":1}
I20260809 08:02:06.176855 27737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.170803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44419 (local address 127.0.0.1:59110)
0809 08:02:06.171280 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.171326 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.171446 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.172257 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.172263 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.172295 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:06.172430 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.172436 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173999 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.174004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.175177 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.175189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.176238 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.176240 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.176352 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.176394 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.176534 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.176702 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":152,"spinlock_wait_cycles":4224,"thread_start_us":79,"threads_started":1}
I20260809 08:02:06.176855 27740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.171490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:38939 (local address 127.0.0.1:55536)
0809 08:02:06.172077 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.172090 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.172170 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.172812 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.172815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.172831 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:06.172908 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.172913 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173858 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.173863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.175391 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.175402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.176330 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.176333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.176412 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.176427 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.176521 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.176695 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":157,"thread_start_us":84,"threads_started":1}
I20260809 08:02:06.177806 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.171891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.8.51.67:38939)
0809 08:02:06.172394 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.172407 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.172431 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:02:06.172500 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.172506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.172690 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.172839 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:06.173018 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173735 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.175526 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.176232 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.176318 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.176464 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.177510 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.177637 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":125,"threads_started":1}
I20260809 08:02:06.177987 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.171173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:39079 (local address 127.0.0.1:58934)
0809 08:02:06.171449 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.171461 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.171533 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.172257 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.172263 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.172296 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:06.172598 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.172604 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173937 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.173940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.175391 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.175402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.177558 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.177562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.177667 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.177702 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.177775 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.177851 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":384,"spinlock_wait_cycles":6272,"thread_start_us":92,"threads_started":1}
I20260809 08:02:06.178663 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.171482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58934 (local address 127.8.51.66:39079)
0809 08:02:06.171770 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.171782 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.171806 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:02:06.171894 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.171899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.172087 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.172367 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:06.172697 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.173830 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.176526 (+ 2696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.177453 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.177559 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.177768 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.177823 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.178496 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":111,"threads_started":1}
I20260809 08:02:06.179818 27382 tablet_service.cc:1467] Processing CreateTablet for tablet c8f24101ae7d43e5995fb370155ed285 (DEFAULT_TABLE table=test-table [id=3dfa869453214fbd8bbff3906e37ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:06.179998 27656 tablet_service.cc:1467] Processing CreateTablet for tablet c8f24101ae7d43e5995fb370155ed285 (DEFAULT_TABLE table=test-table [id=3dfa869453214fbd8bbff3906e37ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:06.180826 27382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f24101ae7d43e5995fb370155ed285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:06.180845 27656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f24101ae7d43e5995fb370155ed285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:06.182677 27517 tablet_service.cc:1467] Processing CreateTablet for tablet c8f24101ae7d43e5995fb370155ed285 (DEFAULT_TABLE table=test-table [id=3dfa869453214fbd8bbff3906e37ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:06.183553 27517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f24101ae7d43e5995fb370155ed285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:06.186484 27743 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Bootstrap starting.
I20260809 08:02:06.188021 27744 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Bootstrap starting.
I20260809 08:02:06.188509 27743 tablet_bootstrap.cc:654] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:06.189209 27743 log.cc:824] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:06.190184 27744 tablet_bootstrap.cc:654] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:06.190405 27746 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Bootstrap starting.
I20260809 08:02:06.190972 27744 log.cc:824] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:06.191212 27743 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: No bootstrap required, opened a new log
I20260809 08:02:06.191401 27743 ts_tablet_manager.cc:1397] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:06.192670 27744 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: No bootstrap required, opened a new log
I20260809 08:02:06.192724 27746 tablet_bootstrap.cc:654] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:06.192859 27744 ts_tablet_manager.cc:1397] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:06.193465 27746 log.cc:824] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:06.195322 27746 tablet_bootstrap.cc:492] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: No bootstrap required, opened a new log
I20260809 08:02:06.195497 27746 ts_tablet_manager.cc:1397] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260809 08:02:06.195466 27743 raft_consensus.cc:348] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.195726 27743 raft_consensus.cc:374] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:06.195773 27743 raft_consensus.cc:729] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe79115a401e4dc89207e0e0f7eef1b8, State: Initialized, Role: FOLLOWER
I20260809 08:02:06.196260 27743 consensus_queue.cc:260] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.196198 27744 raft_consensus.cc:348] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.196420 27744 raft_consensus.cc:374] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:06.196487 27744 raft_consensus.cc:729] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf81045f9f4c4221906e8298e8943a22, State: Initialized, Role: FOLLOWER
I20260809 08:02:06.196861 27744 consensus_queue.cc:260] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.197136 27743 ts_tablet_manager.cc:1428] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:02:06.197446 27451 heartbeater.cc:503] Master 127.8.51.126:40101 was elected leader, sending a full tablet report...
I20260809 08:02:06.197448 27726 heartbeater.cc:503] Master 127.8.51.126:40101 was elected leader, sending a full tablet report...
I20260809 08:02:06.197706 27744 ts_tablet_manager.cc:1428] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 08:02:06.199416 27746 raft_consensus.cc:348] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.199672 27746 raft_consensus.cc:374] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:06.199735 27746 raft_consensus.cc:729] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc893b08bcd848ffbcda1af53bd5f79e, State: Initialized, Role: FOLLOWER
I20260809 08:02:06.200117 27746 consensus_queue.cc:260] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.200641 27588 heartbeater.cc:503] Master 127.8.51.126:40101 was elected leader, sending a full tablet report...
I20260809 08:02:06.201061 27746 ts_tablet_manager.cc:1428] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 08:02:06.263713 27749 raft_consensus.cc:482] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260809 08:02:06.263773 27452 tablet.cc:2369] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:06.263990 27749 raft_consensus.cc:504] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.265148 27749 leader_election.cc:288] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf81045f9f4c4221906e8298e8943a22 (127.8.51.65:44419), cc893b08bcd848ffbcda1af53bd5f79e (127.8.51.66:39079)
I20260809 08:02:06.268810 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.265535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38543 (local address 127.8.51.65:44419)
0809 08:02:06.265732 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.265737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.265761 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:02:06.265808 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.265811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.265852 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.265948 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:06.266236 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.266783 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.267881 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.268268 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.268390 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.268450 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.268627 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.268697 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260809 08:02:06.268810 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.265330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44419 (local address 127.8.51.67:38543)
0809 08:02:06.265456 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.265472 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.265599 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.265965 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.265968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.265986 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:06.266107 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.266113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.266901 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.266906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.267746 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.267755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.268391 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.268394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.268494 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.268518 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.268608 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.268678 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":26}
I20260809 08:02:06.269016 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.265551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:59887 (local address 127.8.51.66:39079)
0809 08:02:06.265732 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.265736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.265933 (+ 197us) server_negotiation.cc:407] Connection header received
0809 08:02:06.266077 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.266088 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.266133 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.266210 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:06.266491 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.266978 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.268017 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.268409 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.268525 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.268579 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.268774 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.268860 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 08:02:06.269362 27752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.265438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:39079 (local address 127.8.51.67:59887)
0809 08:02:06.265848 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.265858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:06.265969 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:06.266241 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:06.266244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:06.266259 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:06.266368 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.266372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.267089 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.267093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.267896 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:06.267905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.268529 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.268533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:06.268630 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.268654 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 08:02:06.269150 (+ 496us) client_negotiation.cc:240] Negotiation successful
0809 08:02:06.269225 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":21,"thread_start_us":151,"threads_started":1}
I20260809 08:02:06.269508 27402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8f24101ae7d43e5995fb370155ed285" candidate_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf81045f9f4c4221906e8298e8943a22" is_pre_election: true
I20260809 08:02:06.269873 27402 raft_consensus.cc:2454] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe79115a401e4dc89207e0e0f7eef1b8 in term 0.
I20260809 08:02:06.269973 27538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8f24101ae7d43e5995fb370155ed285" candidate_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" is_pre_election: true
I20260809 08:02:06.270251 27538 raft_consensus.cc:2454] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe79115a401e4dc89207e0e0f7eef1b8 in term 0.
I20260809 08:02:06.270360 27609 leader_election.cc:302] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf81045f9f4c4221906e8298e8943a22, fe79115a401e4dc89207e0e0f7eef1b8; no voters:
I20260809 08:02:06.270709 27749 raft_consensus.cc:2781] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:06.270781 27749 raft_consensus.cc:482] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:06.270812 27749 raft_consensus.cc:3037] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:06.271904 27749 raft_consensus.cc:504] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.272223 27749 leader_election.cc:288] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [CANDIDATE]: Term 1 election: Requested vote from peers cf81045f9f4c4221906e8298e8943a22 (127.8.51.65:44419), cc893b08bcd848ffbcda1af53bd5f79e (127.8.51.66:39079)
I20260809 08:02:06.272573 27402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8f24101ae7d43e5995fb370155ed285" candidate_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf81045f9f4c4221906e8298e8943a22"
I20260809 08:02:06.272573 27538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8f24101ae7d43e5995fb370155ed285" candidate_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc893b08bcd848ffbcda1af53bd5f79e"
I20260809 08:02:06.272691 27538 raft_consensus.cc:3037] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:06.272703 27402 raft_consensus.cc:3037] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:06.273972 27402 raft_consensus.cc:2454] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe79115a401e4dc89207e0e0f7eef1b8 in term 1.
I20260809 08:02:06.273972 27538 raft_consensus.cc:2454] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe79115a401e4dc89207e0e0f7eef1b8 in term 1.
I20260809 08:02:06.274267 27608 leader_election.cc:302] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc893b08bcd848ffbcda1af53bd5f79e, fe79115a401e4dc89207e0e0f7eef1b8; no voters:
I20260809 08:02:06.274463 27749 raft_consensus.cc:2781] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:06.274650 27749 raft_consensus.cc:686] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 1 LEADER]: Becoming Leader. State: Replica: fe79115a401e4dc89207e0e0f7eef1b8, State: Running, Role: LEADER
I20260809 08:02:06.274973 27749 consensus_queue.cc:237] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } }
I20260809 08:02:06.277879 27255 catalog_manager.cc:5495] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe79115a401e4dc89207e0e0f7eef1b8 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe79115a401e4dc89207e0e0f7eef1b8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 38939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 } health_report { overall_health: UNKNOWN } } }
I20260809 08:02:06.301689 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.298106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55546 (local address 127.8.51.67:38939)
0809 08:02:06.298244 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:06.298249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:06.298263 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:02:06.298381 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:06.298383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:06.298434 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:06.298548 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:06.298788 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.299323 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.300194 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:06.300427 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:06.300562 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:06.300872 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:06.301289 (+ 417us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:06.301416 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:06.301449 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 08:02:06.301496 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:06.307626 27402 raft_consensus.cc:1261] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 1 FOLLOWER]: Refusing update from remote peer fe79115a401e4dc89207e0e0f7eef1b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:06.307626 27538 raft_consensus.cc:1261] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 1 FOLLOWER]: Refusing update from remote peer fe79115a401e4dc89207e0e0f7eef1b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:06.308437 27749 consensus_queue.cc:1035] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc893b08bcd848ffbcda1af53bd5f79e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 39079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:06.308698 27753 consensus_queue.cc:1035] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf81045f9f4c4221906e8298e8943a22" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:06.317116 27758 mvcc.cc:205] Tried to move back new op lower bound from 7316531307748249600 to 7316531307624529920. Current Snapshot: MvccSnapshot[applied={T|T < 7316531307748249600}]
I20260809 08:02:06.318440 27757 mvcc.cc:205] Tried to move back new op lower bound from 7316531307748249600 to 7316531307624529920. Current Snapshot: MvccSnapshot[applied={T|T < 7316531307748249600}]
I20260809 08:02:06.323297 27252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:06.323450 27252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:06.325673 27252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5a886b05ab74107b7fa5995068bc97a: Sending DeleteTablet for 3 replicas of tablet c8f24101ae7d43e5995fb370155ed285
I20260809 08:02:06.326398 27656 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f24101ae7d43e5995fb370155ed285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:06 UTC) from {username='slave'} at 127.0.0.1:55536
I20260809 08:02:06.326504 27382 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f24101ae7d43e5995fb370155ed285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:06 UTC) from {username='slave'} at 127.0.0.1:59110
I20260809 08:02:06.326862 27765 tablet_replica.cc:330] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: stopping tablet replica
I20260809 08:02:06.326887 27766 tablet_replica.cc:330] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22: stopping tablet replica
I20260809 08:02:06.326882 27517 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f24101ae7d43e5995fb370155ed285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:06 UTC) from {username='slave'} at 127.0.0.1:58934
I20260809 08:02:06.327059 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27316
I20260809 08:02:06.327189 27766 raft_consensus.cc:2229] T c8f24101ae7d43e5995fb370155ed285 P cf81045f9f4c4221906e8298e8943a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:06.334496 27765 raft_consensus.cc:2229] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:02:06.334901 27765 raft_consensus.cc:2258] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:06.336133 27765 ts_tablet_manager.cc:1905] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:06.337764 27767 tablet_replica.cc:330] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: stopping tablet replica
I20260809 08:02:06.338117 27767 raft_consensus.cc:2229] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:06.338428 27767 raft_consensus.cc:2258] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:06.338547 27765 ts_tablet_manager.cc:1918] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:06.338668 27765 log.cc:1196] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/c8f24101ae7d43e5995fb370155ed285
I20260809 08:02:06.339439 27765 ts_tablet_manager.cc:1939] T c8f24101ae7d43e5995fb370155ed285 P fe79115a401e4dc89207e0e0f7eef1b8: Deleting consensus metadata
I20260809 08:02:06.339982 27767 ts_tablet_manager.cc:1905] T c8f24101ae7d43e5995fb370155ed285 P cc893b08bcd848ffbcda1af53bd5f79e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:06.340584 27241 catalog_manager.cc:4841] TS fe79115a401e4dc89207e0e0f7eef1b8 (127.8.51.67:38939): tablet c8f24101ae7d43e5995fb370155ed285 (table test-table [id=3dfa869453214fbd8bbff3906e37ca4e]) successfully deleted
I20260809 08:02:06.340883 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27454
W20260809 08:02:06.340876 27241 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:44419 (error 108)
I20260809 08:02:06.346323 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.346053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:44419 (local address 127.0.0.1:59118)
0809 08:02:06.346181 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.346252 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:44419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 08:02:06.346484 27241 catalog_manager.cc:4584] TS cf81045f9f4c4221906e8298e8943a22 (127.8.51.65:44419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c8f24101ae7d43e5995fb370155ed285: Network error: Client connection negotiation failed: client connection to 127.8.51.65:44419: connect: Connection refused (error 111)
I20260809 08:02:06.349133 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27591
I20260809 08:02:06.349239 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:06.348983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:39079 (local address 127.0.0.1:58942)
0809 08:02:06.349102 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:06.349145 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.66:39079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 08:02:06.355186 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27222
2026-08-09T08:02:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1075 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:06 dist-test-slave-njxd krb5kdc[27771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:06 dist-test-slave-njxd krb5kdc[27771](info): set up 2 sockets
Aug 09 08:02:06 dist-test-slave-njxd krb5kdc[27771](info): commencing operation
krb5kdc: starting...
W20260809 08:02:07.414765 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:07 dist-test-slave-njxd krb5kdc[27771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:07.544883 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45045
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:07.702319 27784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:07.702950 27784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:07.703141 27784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:07.710625 27784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:07.710773 27784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:07.710852 27784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:07.710938 27784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:07.711035 27784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:07.720656 27784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:07.723168 27784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:07.725461 27784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:07.741770 27790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:07.741735 27791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:07.741839 27793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:07.742574 27784 server_base.cc:1034] running on GCE node
I20260809 08:02:07.743737 27784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:07.746191 27784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:07.749531 27784 hybrid_clock.cc:648] HybridClock initialized: now 1786262527749443 us; error 103 us; skew 500 ppm
Aug 09 08:02:07 dist-test-slave-njxd krb5kdc[27771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262527, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:07.755142 27784 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:07.757046 27784 webserver.cc:460] Webserver started at http://127.8.51.126:35715/ using document root <none> and password file <none>
I20260809 08:02:07.758332 27784 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:07.758543 27784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:07.758999 27784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:07.764511 27784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "00da294deccc430fa6357bfcfdf0df7a"
format_stamp: "Formatted at 2026-08-09 08:02:07 on dist-test-slave-njxd"
server_key: "51d18bd1bdd981527c7e210d1d94e74f"
server_key_iv: "152135f73aa9f5da372be96c416c7896"
server_key_version: "encryptionkey@0"
I20260809 08:02:07.766376 27784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "00da294deccc430fa6357bfcfdf0df7a"
format_stamp: "Formatted at 2026-08-09 08:02:07 on dist-test-slave-njxd"
server_key: "51d18bd1bdd981527c7e210d1d94e74f"
server_key_iv: "152135f73aa9f5da372be96c416c7896"
server_key_version: "encryptionkey@0"
I20260809 08:02:07.774633 27784 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260809 08:02:07.779599 27800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:07.782166 27784 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:02:07.782464 27784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "00da294deccc430fa6357bfcfdf0df7a"
format_stamp: "Formatted at 2026-08-09 08:02:07 on dist-test-slave-njxd"
server_key: "51d18bd1bdd981527c7e210d1d94e74f"
server_key_iv: "152135f73aa9f5da372be96c416c7896"
server_key_version: "encryptionkey@0"
I20260809 08:02:07.782666 27784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:07.819710 27784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:07.826033 27784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:07.826468 27784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:07.842162 27784 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45045
I20260809 08:02:07.842180 27855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45045 every 8 connection(s)
I20260809 08:02:07.844130 27784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:07.845140 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27784
I20260809 08:02:07.845417 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:07.846040 8397 external_mini_cluster.cc:1428] Setting key 7bfba1fb97f3ab7856540b2737becd65
I20260809 08:02:07.851420 27856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:07.865192 27856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: Bootstrap starting.
Aug 09 08:02:07 dist-test-slave-njxd krb5kdc[27771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:07.869910 27856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:07.871259 27856 log.cc:824] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:07.875334 27856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: No bootstrap required, opened a new log
I20260809 08:02:07.876538 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:07.849113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42194 (local address 127.8.51.126:45045)
0809 08:02:07.850011 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:07.850046 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:07.850107 (+ 61us) server_negotiation.cc:407] Connection header received
0809 08:02:07.852214 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:07.852289 (+ 75us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:07.853216 (+ 927us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:07.854137 (+ 921us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:07.855380 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:07.858207 (+ 2827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:07.859761 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:07.861481 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:07.861912 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:07.866716 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:07.866723 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:07.866747 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:07.866796 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:07.870485 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:07.871348 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:07.871385 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:07.871394 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:07.871671 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:07.872284 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:07.872301 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:07.872305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:07.873058 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:07.873475 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:07.874241 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 08:02:07.874892 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":222,"threads_started":1}
I20260809 08:02:07.883999 27856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } }
I20260809 08:02:07.884455 27856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:07.884608 27856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00da294deccc430fa6357bfcfdf0df7a, State: Initialized, Role: FOLLOWER
I20260809 08:02:07.885432 27856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } }
I20260809 08:02:07.885740 27856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:07.885910 27856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:07.886111 27856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:07.887889 27856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } }
I20260809 08:02:07.888521 27856 leader_election.cc:302] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00da294deccc430fa6357bfcfdf0df7a; no voters:
I20260809 08:02:07.889142 27856 leader_election.cc:288] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:07.889361 27863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:07.889845 27863 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [term 1 LEADER]: Becoming Leader. State: Replica: 00da294deccc430fa6357bfcfdf0df7a, State: Running, Role: LEADER
I20260809 08:02:07.890506 27863 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } }
I20260809 08:02:07.891829 27856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:07.893397 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00da294deccc430fa6357bfcfdf0df7a. Latest consensus state: current_term: 1 leader_uuid: "00da294deccc430fa6357bfcfdf0df7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } } }
I20260809 08:02:07.893721 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:07.893752 27864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00da294deccc430fa6357bfcfdf0df7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00da294deccc430fa6357bfcfdf0df7a" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45045 } } }
I20260809 08:02:07.893956 27864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:07.894783 27872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:07.899755 27872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:07.912571 27872 catalog_manager.cc:1347] Generated new cluster ID: 00d25b8947cf43c2b285f76f56cc2e18
I20260809 08:02:07.912710 27872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:07.928218 27872 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:07.930887 27872 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:07.956802 27872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: Generated new TSK 0
I20260809 08:02:07.958407 27872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:02:08.013068 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:08.136416 27885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:08.136683 27885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:08.136722 27885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:08.140473 27885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:08.140520 27885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:08.140618 27885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:08.145517 27885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:08.146524 27885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:08.147500 27885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:08.157119 27891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:08.157238 27885 server_base.cc:1034] running on GCE node
W20260809 08:02:08.157130 27893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:08.157130 27890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:08.157784 27885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:08.158358 27885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:08.159516 27885 hybrid_clock.cc:648] HybridClock initialized: now 1786262528159499 us; error 30 us; skew 500 ppm
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:08.166234 27885 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:02:08.167128 27885 webserver.cc:460] Webserver started at http://127.8.51.65:40785/ using document root <none> and password file <none>
I20260809 08:02:08.167721 27885 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:08.167783 27885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:08.168000 27885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:08.170122 27885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "0451509da8fb4544a732ca610842a50e"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "114edec2e8c72990ab9f4cf83edefcb1"
server_key_iv: "87396fd734ff2e32c1acb9b45f3f6dd5"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.170696 27885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "0451509da8fb4544a732ca610842a50e"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "114edec2e8c72990ab9f4cf83edefcb1"
server_key_iv: "87396fd734ff2e32c1acb9b45f3f6dd5"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.174279 27885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:08.176671 27900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.177939 27885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:08.178069 27885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "0451509da8fb4544a732ca610842a50e"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "114edec2e8c72990ab9f4cf83edefcb1"
server_key_iv: "87396fd734ff2e32c1acb9b45f3f6dd5"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.178174 27885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:08.199292 27885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:08.202219 27885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:08.202425 27885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:08.203012 27885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:08.203822 27885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:08.203904 27885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.203996 27885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:08.204047 27885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.213208 27885 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:38117
I20260809 08:02:08.213230 28020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:38117 every 8 connection(s)
I20260809 08:02:08.214212 27885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:08.221207 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 27885
I20260809 08:02:08.221380 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:08.221750 8397 external_mini_cluster.cc:1428] Setting key 3b64f4e8c2ed03ba81b566d214f4d69b
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:08.227769 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.216015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:41429 (local address 127.8.51.126:45045)
0809 08:02:08.216164 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.216168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.217433 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 08:02:08.218331 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.218334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.218382 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.218459 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:08.219592 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.220142 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.221192 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.221567 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.221695 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.224090 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:08.224094 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:08.224095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:08.224116 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:08.225678 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.226188 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.226192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.226194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.226279 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.226625 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.226630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.226637 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.226830 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:08.226939 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.227452 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.227582 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 08:02:08.228538 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.216388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45045 (local address 127.8.51.65:41429)
0809 08:02:08.217260 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.217302 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.218138 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.218621 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.218627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.218980 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:08.219462 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.219473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.220246 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.220260 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.221065 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.221073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.221730 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.221733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.221929 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.222571 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:08.222586 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:08.223933 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:08.225809 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.225815 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.225829 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.226083 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.226372 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.226376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.226378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.226519 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.226938 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:08.226945 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:08.227201 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.227409 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.227724 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":538,"threads_started":1}
I20260809 08:02:08.229841 28021 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45045
I20260809 08:02:08.230108 28021 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:08.230629 28021 heartbeater.cc:511] Master 127.8.51.126:45045 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:02:08.232213 27817 ts_manager.cc:194] Registered new tserver with Master: 0451509da8fb4544a732ca610842a50e (127.8.51.65:38117)
I20260809 08:02:08.233323 27817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:41429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:02:08.250633 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:08.358873 28026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:08.359158 28026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:08.359251 28026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:08.363205 28026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:08.363287 28026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:08.363373 28026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:08.368450 28026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:08.369444 28026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:08.370508 28026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:08.379711 28031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:08.379763 28034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:08.379907 28026 server_base.cc:1034] running on GCE node
W20260809 08:02:08.379925 28032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:08.380429 28026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:08.381057 28026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:08.382237 28026 hybrid_clock.cc:648] HybridClock initialized: now 1786262528382211 us; error 45 us; skew 500 ppm
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:08.385072 28026 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:02:08.386009 28026 webserver.cc:460] Webserver started at http://127.8.51.66:39793/ using document root <none> and password file <none>
I20260809 08:02:08.386569 28026 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:08.386656 28026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:08.386880 28026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:08.388793 28026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "ecd91bafa24e400791f492fee67f6367"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "00697ed160d522024575c27bfdae2d44"
server_key_iv: "215c096faf8b16e6ecc4569182dc6ede"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.389353 28026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "ecd91bafa24e400791f492fee67f6367"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "00697ed160d522024575c27bfdae2d44"
server_key_iv: "215c096faf8b16e6ecc4569182dc6ede"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.393249 28026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 08:02:08.395699 28042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.396878 28026 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:08.397006 28026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "ecd91bafa24e400791f492fee67f6367"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "00697ed160d522024575c27bfdae2d44"
server_key_iv: "215c096faf8b16e6ecc4569182dc6ede"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.397111 28026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:08.406925 28026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:08.410012 28026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:08.410200 28026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:08.410732 28026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:08.411453 28026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:08.411518 28026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.411590 28026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:08.411640 28026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.420310 28026 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:35089
I20260809 08:02:08.420339 28163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:35089 every 8 connection(s)
I20260809 08:02:08.421142 28026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:08.426658 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28026
I20260809 08:02:08.426808 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:08.427095 8397 external_mini_cluster.cc:1428] Setting key 2a4354fb4aff08286f5fe851d784076e
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:08.435086 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.422855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53701 (local address 127.8.51.126:45045)
0809 08:02:08.423026 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.423032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.423811 (+ 779us) server_negotiation.cc:407] Connection header received
0809 08:02:08.424659 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.424662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.424711 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.424796 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:08.425984 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.426537 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.427948 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.428193 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.428308 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.431098 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:08.431102 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:08.431105 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:08.431139 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:08.432565 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.433081 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.433086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.433088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.433173 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.433514 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.433519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.433521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.433773 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:08.433887 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.434653 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.434844 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 08:02:08.435829 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.423210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45045 (local address 127.8.51.66:53701)
0809 08:02:08.423657 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.423696 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.424438 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.424956 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.424962 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.425320 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:08.425850 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.425863 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.426680 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.426684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.427816 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.427830 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.428359 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.428363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.428539 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.429163 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:08.429179 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:08.430923 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:08.432694 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.432701 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.432716 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.432974 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.433271 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.433276 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.433278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.433417 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.433949 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:08.433955 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:08.434299 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.434562 (+ 263us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.434910 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":113,"threads_started":1}
I20260809 08:02:08.437045 28164 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45045
I20260809 08:02:08.437302 28164 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:02:08.437861 28164 heartbeater.cc:511] Master 127.8.51.126:45045 requested a full tablet report, sending...
I20260809 08:02:08.438971 27817 ts_manager.cc:194] Registered new tserver with Master: ecd91bafa24e400791f492fee67f6367 (127.8.51.66:35089)
I20260809 08:02:08.439541 27817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:53701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:02:08.456863 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:08.567420 28169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:08.567682 28169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:08.567725 28169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:08.571650 28169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:08.571699 28169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:08.571770 28169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:08.576867 28169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:45045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:08.577831 28169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:08.578792 28169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:08.588336 28177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:08.588287 28174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:08.588469 28175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:08.588892 28169 server_base.cc:1034] running on GCE node
I20260809 08:02:08.589273 28169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:08.589962 28169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:08.591228 28169 hybrid_clock.cc:648] HybridClock initialized: now 1786262528591190 us; error 53 us; skew 500 ppm
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:08.594200 28169 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:02:08.595204 28169 webserver.cc:460] Webserver started at http://127.8.51.67:45797/ using document root <none> and password file <none>
I20260809 08:02:08.595757 28169 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:08.595849 28169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:08.596079 28169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:08.598083 28169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "6631062a255848c7bad8a42b30c06a90"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "23284297e979c9c210d586559c51291d"
server_key_iv: "414065811b7bee613a61c92d730a4aa3"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.598637 28169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "6631062a255848c7bad8a42b30c06a90"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "23284297e979c9c210d586559c51291d"
server_key_iv: "414065811b7bee613a61c92d730a4aa3"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.602314 28169 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:08.604647 28184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.605928 28169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:08.606065 28169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "6631062a255848c7bad8a42b30c06a90"
format_stamp: "Formatted at 2026-08-09 08:02:08 on dist-test-slave-njxd"
server_key: "23284297e979c9c210d586559c51291d"
server_key_iv: "414065811b7bee613a61c92d730a4aa3"
server_key_version: "encryptionkey@0"
I20260809 08:02:08.606187 28169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:08.620407 28169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:08.623127 28169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:08.623327 28169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:08.623893 28169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:08.624691 28169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:08.624759 28169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.624835 28169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:08.624881 28169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:08.633625 28169 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:41897
I20260809 08:02:08.633675 28302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:41897 every 8 connection(s)
I20260809 08:02:08.634456 28169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
Aug 09 08:02:08 dist-test-slave-njxd krb5kdc[27771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262528, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:08.643874 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28169
I20260809 08:02:08.644022 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:08.644362 8397 external_mini_cluster.cc:1428] Setting key 090268bdc353e3e83affac7fb67b0337
I20260809 08:02:08.647423 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.636227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:37913 (local address 127.8.51.126:45045)
0809 08:02:08.636363 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.636367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.637134 (+ 767us) server_negotiation.cc:407] Connection header received
0809 08:02:08.638076 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.638079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.638162 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.638270 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:08.639390 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.639959 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.641033 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.641252 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.641362 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.643734 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:08.643737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:08.643739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:08.643762 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:08.645361 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.645944 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.645946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.645948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.646018 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.646373 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.646375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.646377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.646630 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:08.646713 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.647207 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.647305 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:08.648226 28306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.636565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:45045 (local address 127.8.51.67:37913)
0809 08:02:08.636991 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.637030 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.637876 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.638439 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.638446 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.638788 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:08.639247 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.639260 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.640081 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.640086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.640909 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.640918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.641399 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.641403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.641562 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.642122 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:08.642137 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:08.643510 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:08.645480 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.645486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.645499 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.645839 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.646104 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:08.646107 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:08.646108 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:08.646279 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:08.646737 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:08.646743 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:08.646977 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.647137 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.647377 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260809 08:02:08.649289 28303 heartbeater.cc:347] Connected to a master server at 127.8.51.126:45045
I20260809 08:02:08.649524 28303 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:08.650058 28303 heartbeater.cc:511] Master 127.8.51.126:45045 requested a full tablet report, sending...
I20260809 08:02:08.651005 27817 ts_manager.cc:194] Registered new tserver with Master: 6631062a255848c7bad8a42b30c06a90 (127.8.51.67:41897)
I20260809 08:02:08.651598 27817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:37913
I20260809 08:02:08.658560 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:08.668265 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.660524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42206 (local address 127.8.51.126:45045)
0809 08:02:08.660701 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.660706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.660867 (+ 161us) server_negotiation.cc:407] Connection header received
0809 08:02:08.661025 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.661028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.661072 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.661166 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:08.661930 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.662445 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.663293 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.663528 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.663633 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.665146 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:08.665151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:08.665153 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:08.665178 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:08.666411 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.666917 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.666921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.666923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.667006 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:08.667360 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:08.667365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:08.667370 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:08.667579 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:08.667743 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.668005 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.668103 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 08:02:08.671078 27817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:08.674010 27817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:08.688463 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.682946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.8.51.67:41897)
0809 08:02:08.683343 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.683355 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.683620 (+ 265us) server_negotiation.cc:407] Connection header received
0809 08:02:08.683871 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.683876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.684061 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.684214 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:08.684596 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.685672 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.687159 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.687707 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.687834 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.687986 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.688202 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.688301 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":105,"threads_started":1}
I20260809 08:02:08.688458 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.682277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:38117 (local address 127.0.0.1:56468)
0809 08:02:08.683379 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.683392 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.683501 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.684214 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.684217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.684233 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:08.684330 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.684339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.685441 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.685447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.686921 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.686931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.688006 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.688009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.688106 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.688139 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.688199 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.688310 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1046,"mutex_wait_us":151,"thread_start_us":72,"threads_started":1}
I20260809 08:02:08.688715 28320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.683118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56468 (local address 127.8.51.65:38117)
0809 08:02:08.683763 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.683778 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.683802 (+ 24us) server_negotiation.cc:407] Connection header received
0809 08:02:08.683868 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.683873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.684061 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.684477 (+ 416us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:08.684653 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.685319 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.687044 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.687861 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.688290 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.688429 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.688477 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.688563 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":112,"threads_started":1}
I20260809 08:02:08.689553 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.682154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:35089 (local address 127.0.0.1:33004)
0809 08:02:08.682557 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.682617 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.682794 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.684087 (+ 1293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.684092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.684115 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:08.684258 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.684265 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.685627 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.685630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.687900 (+ 2270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.687914 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.689173 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.689176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.689243 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.689260 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.689353 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.689434 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":973,"thread_start_us":92,"threads_started":1}
I20260809 08:02:08.690199 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.682852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.8.51.66:35089)
0809 08:02:08.683574 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.683591 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.683616 (+ 25us) server_negotiation.cc:407] Connection header received
0809 08:02:08.683696 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.683701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.683912 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.684080 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:08.684368 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.685458 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.688043 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.688854 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.688958 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.689115 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.689940 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.690041 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":151,"threads_started":1}
I20260809 08:02:08.691921 27949 tablet_service.cc:1467] Processing CreateTablet for tablet 18c23a18f6e8465185b865b25038b775 (DEFAULT_TABLE table=test-table [id=71da4d1b5f874abcb2f499236cb17c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:08.692588 28092 tablet_service.cc:1467] Processing CreateTablet for tablet 18c23a18f6e8465185b865b25038b775 (DEFAULT_TABLE table=test-table [id=71da4d1b5f874abcb2f499236cb17c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:08.692941 27949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18c23a18f6e8465185b865b25038b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:08.693528 28092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18c23a18f6e8465185b865b25038b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:08.697785 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.682519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:41897 (local address 127.0.0.1:53642)
0809 08:02:08.683525 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.683539 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.683688 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.684351 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.684353 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.684371 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:08.684462 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.684467 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.686023 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.686029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.687037 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.687047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.687834 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.687838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.687973 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.688019 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.688159 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.688815 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":5,"thread_start_us":107,"threads_started":1}
I20260809 08:02:08.699306 28321 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Bootstrap starting.
I20260809 08:02:08.699936 28322 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Bootstrap starting.
I20260809 08:02:08.700564 28234 tablet_service.cc:1467] Processing CreateTablet for tablet 18c23a18f6e8465185b865b25038b775 (DEFAULT_TABLE table=test-table [id=71da4d1b5f874abcb2f499236cb17c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:08.701517 28234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18c23a18f6e8465185b865b25038b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:08.701663 28321 tablet_bootstrap.cc:654] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:08.702345 28322 tablet_bootstrap.cc:654] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:08.702991 28321 log.cc:824] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:08.703058 28322 log.cc:824] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:08.704852 28322 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: No bootstrap required, opened a new log
I20260809 08:02:08.704933 28321 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: No bootstrap required, opened a new log
I20260809 08:02:08.705073 28322 ts_tablet_manager.cc:1397] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:08.705196 28321 ts_tablet_manager.cc:1397] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.005s
I20260809 08:02:08.707952 28325 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Bootstrap starting.
I20260809 08:02:08.707839 28322 raft_consensus.cc:348] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.708210 28322 raft_consensus.cc:374] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:08.708309 28322 raft_consensus.cc:729] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd91bafa24e400791f492fee67f6367, State: Initialized, Role: FOLLOWER
I20260809 08:02:08.708848 28322 consensus_queue.cc:260] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.708837 28321 raft_consensus.cc:348] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.709061 28321 raft_consensus.cc:374] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:08.709136 28321 raft_consensus.cc:729] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0451509da8fb4544a732ca610842a50e, State: Initialized, Role: FOLLOWER
I20260809 08:02:08.709499 28164 heartbeater.cc:503] Master 127.8.51.126:45045 was elected leader, sending a full tablet report...
I20260809 08:02:08.709830 28322 ts_tablet_manager.cc:1428] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 08:02:08.710156 28325 tablet_bootstrap.cc:654] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:08.710682 28321 consensus_queue.cc:260] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.711316 28021 heartbeater.cc:503] Master 127.8.51.126:45045 was elected leader, sending a full tablet report...
I20260809 08:02:08.711607 28321 ts_tablet_manager.cc:1428] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:02:08.713075 28325 log.cc:824] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:08.715142 28325 tablet_bootstrap.cc:492] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: No bootstrap required, opened a new log
I20260809 08:02:08.715286 28325 ts_tablet_manager.cc:1397] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
W20260809 08:02:08.715503 28022 tablet.cc:2369] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:08.717999 28325 raft_consensus.cc:348] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.718243 28325 raft_consensus.cc:374] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:08.718317 28325 raft_consensus.cc:729] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6631062a255848c7bad8a42b30c06a90, State: Initialized, Role: FOLLOWER
I20260809 08:02:08.718691 28325 consensus_queue.cc:260] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.719275 28303 heartbeater.cc:503] Master 127.8.51.126:45045 was elected leader, sending a full tablet report...
I20260809 08:02:08.719558 28325 ts_tablet_manager.cc:1428] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 08:02:08.766492 28326 raft_consensus.cc:482] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:02:08.766789 28326 raft_consensus.cc:504] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.768298 28326 leader_election.cc:288] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0451509da8fb4544a732ca610842a50e (127.8.51.65:38117), 6631062a255848c7bad8a42b30c06a90 (127.8.51.67:41897)
I20260809 08:02:08.772765 28320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.768716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53963 (local address 127.8.51.65:38117)
0809 08:02:08.768911 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.768917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.769674 (+ 757us) server_negotiation.cc:407] Connection header received
0809 08:02:08.769753 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.769757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.769817 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.769909 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:08.770240 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.770758 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.771793 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.772209 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.772326 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.772388 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.772572 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.772643 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 08:02:08.772765 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.768928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:38117 (local address 127.8.51.66:53963)
0809 08:02:08.769050 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.769067 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.769170 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.769947 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.769950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.769972 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:08.770103 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.770110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.770871 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.770875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.771653 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.771662 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.772329 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.772333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.772437 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.772458 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.772554 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.772629 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 08:02:08.773146 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.770020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:45457 (local address 127.8.51.67:41897)
0809 08:02:08.770179 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.770184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.770197 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:08.770251 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.770253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.770290 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.770373 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:08.770635 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.771125 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.772184 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.772596 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.772719 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.772777 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.772978 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.773052 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 08:02:08.773388 27971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c23a18f6e8465185b865b25038b775" candidate_uuid: "ecd91bafa24e400791f492fee67f6367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0451509da8fb4544a732ca610842a50e" is_pre_election: true
I20260809 08:02:08.773484 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.769448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:41897 (local address 127.8.51.66:45457)
0809 08:02:08.769966 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.769979 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:08.770095 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:08.770389 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:08.770392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:08.770406 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:08.770522 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.770527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.771239 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.771242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.772058 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:08.772067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.772724 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.772728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:08.772826 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.772851 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 08:02:08.773315 (+ 464us) client_negotiation.cc:240] Negotiation successful
0809 08:02:08.773385 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":171,"threads_started":1}
I20260809 08:02:08.773766 27971 raft_consensus.cc:2454] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd91bafa24e400791f492fee67f6367 in term 0.
I20260809 08:02:08.774271 28046 leader_election.cc:302] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0451509da8fb4544a732ca610842a50e, ecd91bafa24e400791f492fee67f6367; no voters:
I20260809 08:02:08.774273 28255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c23a18f6e8465185b865b25038b775" candidate_uuid: "ecd91bafa24e400791f492fee67f6367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6631062a255848c7bad8a42b30c06a90" is_pre_election: true
I20260809 08:02:08.774595 28326 raft_consensus.cc:2781] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:08.774597 28255 raft_consensus.cc:2454] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd91bafa24e400791f492fee67f6367 in term 0.
I20260809 08:02:08.774700 28326 raft_consensus.cc:482] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:08.774765 28326 raft_consensus.cc:3037] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:08.775900 28326 raft_consensus.cc:504] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.776259 28326 leader_election.cc:288] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [CANDIDATE]: Term 1 election: Requested vote from peers 0451509da8fb4544a732ca610842a50e (127.8.51.65:38117), 6631062a255848c7bad8a42b30c06a90 (127.8.51.67:41897)
I20260809 08:02:08.776649 28255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c23a18f6e8465185b865b25038b775" candidate_uuid: "ecd91bafa24e400791f492fee67f6367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6631062a255848c7bad8a42b30c06a90"
I20260809 08:02:08.776634 27971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c23a18f6e8465185b865b25038b775" candidate_uuid: "ecd91bafa24e400791f492fee67f6367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0451509da8fb4544a732ca610842a50e"
I20260809 08:02:08.776767 27971 raft_consensus.cc:3037] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:08.776767 28255 raft_consensus.cc:3037] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:08.778132 28255 raft_consensus.cc:2454] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd91bafa24e400791f492fee67f6367 in term 1.
I20260809 08:02:08.778132 27971 raft_consensus.cc:2454] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd91bafa24e400791f492fee67f6367 in term 1.
I20260809 08:02:08.778429 28046 leader_election.cc:302] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0451509da8fb4544a732ca610842a50e, ecd91bafa24e400791f492fee67f6367; no voters:
I20260809 08:02:08.778666 28326 raft_consensus.cc:2781] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:08.778864 28326 raft_consensus.cc:686] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 1 LEADER]: Becoming Leader. State: Replica: ecd91bafa24e400791f492fee67f6367, State: Running, Role: LEADER
I20260809 08:02:08.779193 28326 consensus_queue.cc:237] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } }
I20260809 08:02:08.782513 27816 catalog_manager.cc:5495] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd91bafa24e400791f492fee67f6367 (127.8.51.66). New cstate: current_term: 1 leader_uuid: "ecd91bafa24e400791f492fee67f6367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd91bafa24e400791f492fee67f6367" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 35089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 } health_report { overall_health: UNKNOWN } } }
I20260809 08:02:08.810791 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.807014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33018 (local address 127.8.51.66:35089)
0809 08:02:08.807173 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:08.807178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:08.807194 (+ 16us) server_negotiation.cc:407] Connection header received
0809 08:02:08.807355 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:08.807358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:08.807413 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:08.807526 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:08.807768 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.808277 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.809163 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:08.809404 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:08.809516 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:08.809888 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:08.810314 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:08.810474 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:08.810561 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 08:02:08.810597 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 08:02:08.816715 28255 raft_consensus.cc:1261] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 1 FOLLOWER]: Refusing update from remote peer ecd91bafa24e400791f492fee67f6367: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:08.816718 27971 raft_consensus.cc:1261] T 18c23a18f6e8465185b865b25038b775 P 0451509da8fb4544a732ca610842a50e [term 1 FOLLOWER]: Refusing update from remote peer ecd91bafa24e400791f492fee67f6367: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:08.817442 28331 consensus_queue.cc:1035] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0451509da8fb4544a732ca610842a50e" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:08.817687 28326 consensus_queue.cc:1035] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6631062a255848c7bad8a42b30c06a90" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:08.833954 27816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:08.834132 27816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:08.836459 27816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00da294deccc430fa6357bfcfdf0df7a: Sending DeleteTablet for 3 replicas of tablet 18c23a18f6e8465185b865b25038b775
I20260809 08:02:08.837216 28092 tablet_service.cc:1514] Processing DeleteTablet for tablet 18c23a18f6e8465185b865b25038b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:08 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:33004
I20260809 08:02:08.837224 27949 tablet_service.cc:1514] Processing DeleteTablet for tablet 18c23a18f6e8465185b865b25038b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:08 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:56468
I20260809 08:02:08.837733 28345 tablet_replica.cc:330] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: stopping tablet replica
I20260809 08:02:08.837990 28234 tablet_service.cc:1514] Processing DeleteTablet for tablet 18c23a18f6e8465185b865b25038b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:08 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:53642
I20260809 08:02:08.838093 28345 raft_consensus.cc:2229] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:02:08.838428 28345 raft_consensus.cc:2258] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:08.838534 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27885
I20260809 08:02:08.840250 28345 ts_tablet_manager.cc:1905] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:08.843891 28345 ts_tablet_manager.cc:1918] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:08.843987 28345 log.cc:1196] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/18c23a18f6e8465185b865b25038b775
I20260809 08:02:08.844347 28345 ts_tablet_manager.cc:1939] T 18c23a18f6e8465185b865b25038b775 P ecd91bafa24e400791f492fee67f6367: Deleting consensus metadata
I20260809 08:02:08.845566 28346 tablet_replica.cc:330] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: stopping tablet replica
I20260809 08:02:08.845695 27802 catalog_manager.cc:4841] TS ecd91bafa24e400791f492fee67f6367 (127.8.51.66:35089): tablet 18c23a18f6e8465185b865b25038b775 (table test-table [id=71da4d1b5f874abcb2f499236cb17c00]) successfully deleted
I20260809 08:02:08.845963 28346 raft_consensus.cc:2229] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:08.846330 28346 raft_consensus.cc:2258] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 08:02:08.850982 27804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:38117 (error 108)
I20260809 08:02:08.851512 28346 ts_tablet_manager.cc:1905] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:08.851854 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28026
I20260809 08:02:08.854558 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:08.854213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:38117 (local address 127.0.0.1:56472)
0809 08:02:08.854371 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:08.854445 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 08:02:08.854791 27804 catalog_manager.cc:4584] TS 0451509da8fb4544a732ca610842a50e (127.8.51.65:38117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 18c23a18f6e8465185b865b25038b775: Network error: Client connection negotiation failed: client connection to 127.8.51.65:38117: connect: Connection refused (error 111)
I20260809 08:02:08.856900 28346 ts_tablet_manager.cc:1918] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:08.857007 28346 log.cc:1196] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/18c23a18f6e8465185b865b25038b775
I20260809 08:02:08.857383 28346 ts_tablet_manager.cc:1939] T 18c23a18f6e8465185b865b25038b775 P 6631062a255848c7bad8a42b30c06a90: Deleting consensus metadata
I20260809 08:02:08.858619 27803 catalog_manager.cc:4841] TS 6631062a255848c7bad8a42b30c06a90 (127.8.51.67:41897): tablet 18c23a18f6e8465185b865b25038b775 (table test-table [id=71da4d1b5f874abcb2f499236cb17c00]) successfully deleted
I20260809 08:02:08.859757 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28169
I20260809 08:02:08.866402 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 27784
2026-08-09T08:02:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2512 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T08:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:08Z Disabled control of system clock
I20260809 08:02:08.897812 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:44449
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:44449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:09.004982 28352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:09.005223 28352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:09.005255 28352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:09.009198 28352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:09.009253 28352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:09.009267 28352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:09.009284 28352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:09.009299 28352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:09.013837 28352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:44449
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:44449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:09.014849 28352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:09.016213 28352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:09.024282 28360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.024303 28357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.024292 28358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.024415 28352 server_base.cc:1034] running on GCE node
I20260809 08:02:09.025139 28352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:09.026134 28352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:09.027315 28352 hybrid_clock.cc:648] HybridClock initialized: now 1786262529027289 us; error 37 us; skew 500 ppm
I20260809 08:02:09.029003 28352 webserver.cc:460] Webserver started at http://127.8.51.126:42931/ using document root <none> and password file <none>
I20260809 08:02:09.029564 28352 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:09.029726 28352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:09.029971 28352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:09.031917 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "3f02ecf383624f688adb299cf5dff7ab"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "fa6b603c26c6c85087c7f7ebc42fcee3"
server_key_iv: "b6a48320853090564f80e1d55a017034"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.032454 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "3f02ecf383624f688adb299cf5dff7ab"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "fa6b603c26c6c85087c7f7ebc42fcee3"
server_key_iv: "b6a48320853090564f80e1d55a017034"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.036000 28352 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 08:02:09.038368 28366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.039561 28352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:09.039695 28352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "3f02ecf383624f688adb299cf5dff7ab"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "fa6b603c26c6c85087c7f7ebc42fcee3"
server_key_iv: "b6a48320853090564f80e1d55a017034"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.039803 28352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:09.080659 28352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:09.081449 28352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:09.081681 28352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:09.088219 28352 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:44449
I20260809 08:02:09.088258 28421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:44449 every 8 connection(s)
I20260809 08:02:09.089227 28352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:09.092377 28422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:09.093837 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28352
I20260809 08:02:09.093954 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:09.094233 8397 external_mini_cluster.cc:1428] Setting key d0414a160cece27aadedddc1ee05e4c9
I20260809 08:02:09.098649 28422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: Bootstrap starting.
I20260809 08:02:09.101060 28422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:09.102101 28422 log.cc:824] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:09.103761 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.095747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35850 (local address 127.8.51.126:44449)
0809 08:02:09.096391 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.096405 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.096438 (+ 33us) server_negotiation.cc:407] Connection header received
0809 08:02:09.097070 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.097086 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.097452 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.097831 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:09.098258 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.099262 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.100138 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.100801 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.100962 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.102000 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:09.102006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:09.102027 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:09.102467 (+ 440us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:09.102540 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:09.102566 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:09.102665 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.102828 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.103102 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":139,"threads_started":1}
I20260809 08:02:09.104075 28422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: No bootstrap required, opened a new log
I20260809 08:02:09.107676 28422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } }
I20260809 08:02:09.107908 28422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:09.107986 28422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f02ecf383624f688adb299cf5dff7ab, State: Initialized, Role: FOLLOWER
I20260809 08:02:09.108482 28422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } }
I20260809 08:02:09.108637 28422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:09.108726 28422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:09.108824 28422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:09.109782 28422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } }
I20260809 08:02:09.110119 28422 leader_election.cc:302] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f02ecf383624f688adb299cf5dff7ab; no voters:
I20260809 08:02:09.110481 28422 leader_election.cc:288] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:09.110576 28427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:09.110807 28427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [term 1 LEADER]: Becoming Leader. State: Replica: 3f02ecf383624f688adb299cf5dff7ab, State: Running, Role: LEADER
I20260809 08:02:09.111179 28427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } }
I20260809 08:02:09.111747 28422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:09.112887 28428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f02ecf383624f688adb299cf5dff7ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } } }
I20260809 08:02:09.112888 28429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f02ecf383624f688adb299cf5dff7ab. Latest consensus state: current_term: 1 leader_uuid: "3f02ecf383624f688adb299cf5dff7ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f02ecf383624f688adb299cf5dff7ab" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 44449 } } }
I20260809 08:02:09.113045 28428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:09.113049 28429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:09.113386 28437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:09.116488 28437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:09.121973 28437 catalog_manager.cc:1347] Generated new cluster ID: 5a129d89c6cc48e8bfb6a6d75fe674e0
I20260809 08:02:09.122048 28437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:09.133718 28437 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:09.134652 28437 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:09.140077 28437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: Generated new TSK 0
I20260809 08:02:09.140722 28437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:09.151280 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--builtin_ntp_servers=127.8.51.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:09.278827 28447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:09.279078 28447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:09.279151 28447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:09.283420 28447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:09.283484 28447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:09.283538 28447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:09.288508 28447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:09.289667 28447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:09.291083 28447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:09.300752 28455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.300745 28452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.300899 28447 server_base.cc:1034] running on GCE node
W20260809 08:02:09.300745 28453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.301513 28447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:09.302161 28447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:09.303369 28447 hybrid_clock.cc:648] HybridClock initialized: now 1786262529303360 us; error 31 us; skew 500 ppm
I20260809 08:02:09.305145 28447 webserver.cc:460] Webserver started at http://127.8.51.65:40385/ using document root <none> and password file <none>
I20260809 08:02:09.305795 28447 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:09.305888 28447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:09.306120 28447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:09.308115 28447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "5cd06a5d176749988ea32b8bff422ddd"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "dfef02abd8019305d495bc742069eba1"
server_key_iv: "f234e7a1083aa7f7e74f2c6bf21db647"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.308696 28447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "5cd06a5d176749988ea32b8bff422ddd"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "dfef02abd8019305d495bc742069eba1"
server_key_iv: "f234e7a1083aa7f7e74f2c6bf21db647"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.312366 28447 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 08:02:09.314954 28462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.316116 28447 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:02:09.316259 28447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "5cd06a5d176749988ea32b8bff422ddd"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "dfef02abd8019305d495bc742069eba1"
server_key_iv: "f234e7a1083aa7f7e74f2c6bf21db647"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.316375 28447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:09.369004 28447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:09.370107 28447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:09.370340 28447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:09.370962 28447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:09.371958 28447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:09.372004 28447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.372074 28447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:09.372104 28447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.380944 28447 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:33439
I20260809 08:02:09.380975 28579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:33439 every 8 connection(s)
I20260809 08:02:09.381919 28447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:09.389802 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28447
I20260809 08:02:09.389945 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:09.390300 8397 external_mini_cluster.cc:1428] Setting key f5c52881f22bb92ffebf965e0a43c18b
I20260809 08:02:09.390962 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.383740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:58461 (local address 127.8.51.126:44449)
0809 08:02:09.383872 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.383876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.384899 (+ 1023us) server_negotiation.cc:407] Connection header received
0809 08:02:09.386275 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.386277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.386327 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.386404 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:09.387273 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.387778 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.388877 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.389082 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.389159 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.390398 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:09.390402 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:09.390405 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:09.390420 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:09.390444 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:09.390452 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:09.390509 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.390718 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.390801 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 08:02:09.391937 28582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.384137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:44449 (local address 127.8.51.65:58461)
0809 08:02:09.384759 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.384800 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.386088 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.386565 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.386572 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.386656 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:09.387142 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.387154 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.387878 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.387880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.388770 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.388779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.389213 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.389215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.389352 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.390065 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:09.390068 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:09.390136 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:09.390225 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:09.390539 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:09.390549 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:09.390555 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.390707 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.390984 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":101,"threads_started":1}
I20260809 08:02:09.392508 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--builtin_ntp_servers=127.8.51.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:09.393173 28580 heartbeater.cc:347] Connected to a master server at 127.8.51.126:44449
I20260809 08:02:09.393419 28580 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:09.393970 28580 heartbeater.cc:511] Master 127.8.51.126:44449 requested a full tablet report, sending...
I20260809 08:02:09.395399 28384 ts_manager.cc:194] Registered new tserver with Master: 5cd06a5d176749988ea32b8bff422ddd (127.8.51.65:33439)
I20260809 08:02:09.396505 28384 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.65:58461
W20260809 08:02:09.505172 28583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:09.505424 28583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:09.505460 28583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:09.509452 28583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:09.509509 28583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:09.509562 28583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:09.514689 28583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:09.515779 28583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:09.517187 28583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:09.526568 28589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.526576 28590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.526827 28592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.526893 28583 server_base.cc:1034] running on GCE node
I20260809 08:02:09.527302 28583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:09.527874 28583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:09.529036 28583 hybrid_clock.cc:648] HybridClock initialized: now 1786262529529001 us; error 47 us; skew 500 ppm
I20260809 08:02:09.530880 28583 webserver.cc:460] Webserver started at http://127.8.51.66:34367/ using document root <none> and password file <none>
I20260809 08:02:09.531477 28583 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:09.531539 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:09.531823 28583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:09.534085 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "a256eb37658c48598b21cca32fe8542d"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "59ed9fcaf2a3b76dd19443fba73578ec"
server_key_iv: "cba417e1c27f50fa9634e3651c7abf10"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.534682 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "a256eb37658c48598b21cca32fe8542d"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "59ed9fcaf2a3b76dd19443fba73578ec"
server_key_iv: "cba417e1c27f50fa9634e3651c7abf10"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.538426 28583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:02:09.540848 28598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.542109 28583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:09.542228 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "a256eb37658c48598b21cca32fe8542d"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "59ed9fcaf2a3b76dd19443fba73578ec"
server_key_iv: "cba417e1c27f50fa9634e3651c7abf10"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.542335 28583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:09.575939 28583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:09.576694 28583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:09.576905 28583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:09.577523 28583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:09.578506 28583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:09.578554 28583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.578632 28583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:09.578672 28583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.587473 28583 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:44075
I20260809 08:02:09.587503 28716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:44075 every 8 connection(s)
I20260809 08:02:09.588376 28583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:09.589980 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28583
I20260809 08:02:09.590113 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:09.590464 8397 external_mini_cluster.cc:1428] Setting key 73c7b5e0d8899d47fbbe69d18d1f52c6
I20260809 08:02:09.592564 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--builtin_ntp_servers=127.8.51.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:09.599140 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.590244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:55295 (local address 127.8.51.126:44449)
0809 08:02:09.590388 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.590392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.591655 (+ 1263us) server_negotiation.cc:407] Connection header received
0809 08:02:09.593673 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.593675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.593718 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.593782 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:09.594906 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.595755 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.596851 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.597268 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.597396 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.598538 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:09.598545 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:09.598549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:09.598567 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:09.598601 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:09.598616 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:09.598700 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.598852 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.598928 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 08:02:09.599859 28719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.590770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:44449 (local address 127.8.51.66:55295)
0809 08:02:09.591506 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.591556 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.593385 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.593971 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.593982 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.594091 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:09.594762 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.594778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.595887 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.595890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.596723 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.596732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.597430 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.597433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.597619 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.598278 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:09.598279 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:09.598318 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:09.598379 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:09.598713 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:09.598720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:09.598724 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.598812 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.599018 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":141,"threads_started":1}
I20260809 08:02:09.601025 28717 heartbeater.cc:347] Connected to a master server at 127.8.51.126:44449
I20260809 08:02:09.601238 28717 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:09.601792 28717 heartbeater.cc:511] Master 127.8.51.126:44449 requested a full tablet report, sending...
I20260809 08:02:09.602814 28384 ts_manager.cc:194] Registered new tserver with Master: a256eb37658c48598b21cca32fe8542d (127.8.51.66:44075)
I20260809 08:02:09.603559 28384 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.66:55295
W20260809 08:02:09.706226 28720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:09.706459 28720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:09.706521 28720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:09.710310 28720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:09.710356 28720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:09.710446 28720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:09.715351 28720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:44449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:09.716372 28720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:09.717727 28720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:09.727463 28725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:09.727438 28726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.727445 28720 server_base.cc:1034] running on GCE node
W20260809 08:02:09.727428 28728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:09.728021 28720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:09.728654 28720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:09.729811 28720 hybrid_clock.cc:648] HybridClock initialized: now 1786262529729786 us; error 37 us; skew 500 ppm
I20260809 08:02:09.731727 28720 webserver.cc:460] Webserver started at http://127.8.51.67:43553/ using document root <none> and password file <none>
I20260809 08:02:09.732326 28720 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:09.732389 28720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:09.732648 28720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:09.734793 28720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "5ed3c33f5bf74caba1c5f3d138614035"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "96d3e2e1a0192ed1f8a45b52d760eae8"
server_key_iv: "1e1784030c04dd0adc33f263e10b9430"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.735352 28720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "5ed3c33f5bf74caba1c5f3d138614035"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "96d3e2e1a0192ed1f8a45b52d760eae8"
server_key_iv: "1e1784030c04dd0adc33f263e10b9430"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.738938 28720 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:02:09.741341 28734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.742539 28720 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:09.742719 28720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "5ed3c33f5bf74caba1c5f3d138614035"
format_stamp: "Formatted at 2026-08-09 08:02:09 on dist-test-slave-njxd"
server_key: "96d3e2e1a0192ed1f8a45b52d760eae8"
server_key_iv: "1e1784030c04dd0adc33f263e10b9430"
server_key_version: "encryptionkey@0"
I20260809 08:02:09.742830 28720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:09.775266 28720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:09.776121 28720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:09.776342 28720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:09.776980 28720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:09.778034 28720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:09.778108 28720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.778183 28720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:09.778236 28720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:09.786828 28720 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:45457
I20260809 08:02:09.786855 28855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:45457 every 8 connection(s)
I20260809 08:02:09.787714 28720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:02:09.790000 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28720
I20260809 08:02:09.790092 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:09.790462 8397 external_mini_cluster.cc:1428] Setting key bcf9c8cb8a3304fbd28e7178fd4ac0c2
I20260809 08:02:09.797268 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.789617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:39133 (local address 127.8.51.126:44449)
0809 08:02:09.789751 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.789754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.790983 (+ 1229us) server_negotiation.cc:407] Connection header received
0809 08:02:09.792741 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.792745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.792797 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.792883 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:09.793814 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.794339 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.795455 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.795679 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.795796 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.796790 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:09.796794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:09.796796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:09.796816 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:09.796834 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:09.796842 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:09.796919 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.797072 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.797131 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 08:02:09.798122 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.790013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:44449 (local address 127.8.51.67:39133)
0809 08:02:09.790830 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.790876 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.792525 (+ 1649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.793067 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.793074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.793155 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:09.793686 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.793701 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.794466 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.794470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.795332 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.795341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.795830 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.795834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.796006 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.796555 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:09.796557 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:09.796593 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:09.796649 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:09.796921 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:09.796932 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:09.796940 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.797072 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.797347 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":136,"threads_started":1}
I20260809 08:02:09.799077 28856 heartbeater.cc:347] Connected to a master server at 127.8.51.126:44449
I20260809 08:02:09.799305 28856 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:09.799790 28856 heartbeater.cc:511] Master 127.8.51.126:44449 requested a full tablet report, sending...
I20260809 08:02:09.800725 28384 ts_manager.cc:194] Registered new tserver with Master: 5ed3c33f5bf74caba1c5f3d138614035 (127.8.51.67:45457)
I20260809 08:02:09.801266 28384 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.67:39133
I20260809 08:02:09.804291 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:09.809908 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.806239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.8.51.126:44449)
0809 08:02:09.806354 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.806358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.806573 (+ 215us) server_negotiation.cc:407] Connection header received
0809 08:02:09.806657 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.806659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.806702 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.806762 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:09.807019 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.807488 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.808289 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.808478 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.808546 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.809367 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:09.809370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:09.809372 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:09.809382 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:09.809409 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:09.809415 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:09.809498 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.809706 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.809738 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 08:02:09.812691 28384 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:09.815698 28384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:09.829424 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.823863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.8.51.67:45457)
0809 08:02:09.824211 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.824221 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.824263 (+ 42us) server_negotiation.cc:407] Connection header received
0809 08:02:09.824427 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.824434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.824649 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.824811 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:09.825324 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.826490 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.828145 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.828753 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.828875 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.829070 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.829157 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.829248 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":150,"threads_started":1}
I20260809 08:02:09.829417 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.823730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:45457 (local address 127.0.0.1:39190)
0809 08:02:09.824067 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.824111 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.824256 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.824990 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.824998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.825026 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:09.825173 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.825181 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.826611 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.826615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.828014 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.828024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.828875 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.828878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.828990 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.829029 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.829132 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.829254 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":6,"thread_start_us":110,"threads_started":1}
I20260809 08:02:09.829936 28869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.824471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:33439 (local address 127.0.0.1:49214)
0809 08:02:09.825128 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.825143 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.825238 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.825796 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.825799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.825819 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:09.825910 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.825915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.827050 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.827055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.828236 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.828247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.829507 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.829513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.829619 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.829643 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.829704 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.829786 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":37,"thread_start_us":97,"threads_started":1}
I20260809 08:02:09.830152 28872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.824802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44075 (local address 127.0.0.1:54158)
0809 08:02:09.825228 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:09.825240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:09.825328 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:09.825981 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:09.825984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:09.826002 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:09.826109 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.826118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.827387 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.827390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.828508 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:09.828517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.829775 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.829779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:09.829872 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.829892 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 08:02:09.829944 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 08:02:09.830013 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":67,"thread_start_us":95,"threads_started":1}
I20260809 08:02:09.830436 28871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.824616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49214 (local address 127.8.51.65:33439)
0809 08:02:09.824991 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.825000 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.825350 (+ 350us) server_negotiation.cc:407] Connection header received
0809 08:02:09.825440 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.825445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.825654 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.825808 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:09.826047 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.826943 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.828363 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.829139 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.829247 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.829438 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.830156 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.830268 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":63,"threads_started":1}
I20260809 08:02:09.830940 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:09.825203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54158 (local address 127.8.51.66:44075)
0809 08:02:09.825552 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:09.825562 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:09.825608 (+ 46us) server_negotiation.cc:407] Connection header received
0809 08:02:09.825683 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:09.825688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:09.825857 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:09.825999 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:09.826239 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.827241 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.828639 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:09.829394 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:09.830408 (+ 1014us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:09.830621 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:09.830672 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 08:02:09.830769 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":121,"threads_started":1}
I20260809 08:02:09.832541 28786 tablet_service.cc:1467] Processing CreateTablet for tablet 318ea3f2870f4caabfeb3293f9373160 (DEFAULT_TABLE table=test-table [id=86358b7de7f34d6ca318cbcf213064a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:09.833431 28786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318ea3f2870f4caabfeb3293f9373160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:09.833281 28512 tablet_service.cc:1467] Processing CreateTablet for tablet 318ea3f2870f4caabfeb3293f9373160 (DEFAULT_TABLE table=test-table [id=86358b7de7f34d6ca318cbcf213064a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:09.833657 28647 tablet_service.cc:1467] Processing CreateTablet for tablet 318ea3f2870f4caabfeb3293f9373160 (DEFAULT_TABLE table=test-table [id=86358b7de7f34d6ca318cbcf213064a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:09.834347 28512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318ea3f2870f4caabfeb3293f9373160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:09.834597 28647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318ea3f2870f4caabfeb3293f9373160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:09.840342 28874 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Bootstrap starting.
I20260809 08:02:09.841413 28875 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Bootstrap starting.
I20260809 08:02:09.842435 28876 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Bootstrap starting.
I20260809 08:02:09.842522 28874 tablet_bootstrap.cc:654] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:09.843364 28874 log.cc:824] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:09.843479 28875 tablet_bootstrap.cc:654] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:09.844218 28875 log.cc:824] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:09.844306 28876 tablet_bootstrap.cc:654] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:09.845077 28876 log.cc:824] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:09.846457 28875 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: No bootstrap required, opened a new log
I20260809 08:02:09.846658 28875 ts_tablet_manager.cc:1397] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:09.846865 28874 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: No bootstrap required, opened a new log
I20260809 08:02:09.847064 28874 ts_tablet_manager.cc:1397] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 08:02:09.847230 28876 tablet_bootstrap.cc:492] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: No bootstrap required, opened a new log
I20260809 08:02:09.847426 28876 ts_tablet_manager.cc:1397] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:09.850519 28876 raft_consensus.cc:348] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.850755 28876 raft_consensus.cc:374] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:09.850829 28876 raft_consensus.cc:729] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cd06a5d176749988ea32b8bff422ddd, State: Initialized, Role: FOLLOWER
I20260809 08:02:09.850994 28875 raft_consensus.cc:348] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.851063 28874 raft_consensus.cc:348] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.851256 28875 raft_consensus.cc:374] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:09.851255 28874 raft_consensus.cc:374] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:09.851318 28874 raft_consensus.cc:729] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed3c33f5bf74caba1c5f3d138614035, State: Initialized, Role: FOLLOWER
I20260809 08:02:09.851358 28875 raft_consensus.cc:729] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a256eb37658c48598b21cca32fe8542d, State: Initialized, Role: FOLLOWER
I20260809 08:02:09.851302 28876 consensus_queue.cc:260] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.851784 28874 consensus_queue.cc:260] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.851789 28875 consensus_queue.cc:260] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:09.851953 28580 heartbeater.cc:503] Master 127.8.51.126:44449 was elected leader, sending a full tablet report...
I20260809 08:02:09.852771 28874 ts_tablet_manager.cc:1428] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:02:09.852784 28875 ts_tablet_manager.cc:1428] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 08:02:09.853093 28856 heartbeater.cc:503] Master 127.8.51.126:44449 was elected leader, sending a full tablet report...
I20260809 08:02:09.853116 28876 ts_tablet_manager.cc:1428] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260809 08:02:09.853195 28717 heartbeater.cc:503] Master 127.8.51.126:44449 was elected leader, sending a full tablet report...
W20260809 08:02:09.883191 28581 tablet.cc:2369] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 08:02:10.038777 28857 tablet.cc:2369] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:10.044874 28880 raft_consensus.cc:482] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:02:10.045055 28880 raft_consensus.cc:504] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:10.046267 28880 leader_election.cc:288] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ed3c33f5bf74caba1c5f3d138614035 (127.8.51.67:45457), a256eb37658c48598b21cca32fe8542d (127.8.51.66:44075)
I20260809 08:02:10.050571 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.046669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:52675 (local address 127.8.51.67:45457)
0809 08:02:10.046808 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:10.046811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:10.046996 (+ 185us) server_negotiation.cc:407] Connection header received
0809 08:02:10.047263 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:10.047267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:10.047322 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:10.047402 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:10.047768 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.048387 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.049528 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.049944 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.050019 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:10.050066 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:10.050377 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 08:02:10.050450 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 08:02:10.050599 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.046603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:45457 (local address 127.8.51.65:52675)
0809 08:02:10.046890 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:10.046906 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:10.047023 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:10.047438 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:10.047441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:10.047463 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:10.047633 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:10.047639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.048494 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.048498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:10.049388 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:10.049398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.050061 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.050067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:10.050203 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:10.050272 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 08:02:10.050338 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 08:02:10.050412 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":25,"spinlock_wait_cycles":2944,"thread_start_us":123,"threads_started":1}
I20260809 08:02:10.050632 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.047130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:38623 (local address 127.8.51.66:44075)
0809 08:02:10.047404 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:10.047410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:10.047468 (+ 58us) server_negotiation.cc:407] Connection header received
0809 08:02:10.047623 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:10.047626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:10.047677 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:10.047747 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:10.048014 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.048565 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.049646 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.050029 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.050144 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:10.050218 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:10.050453 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 08:02:10.050528 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260809 08:02:10.050613 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.047059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:44075 (local address 127.8.51.65:38623)
0809 08:02:10.047397 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:10.047410 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:10.047509 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:10.047774 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:10.047777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:10.047793 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:10.047905 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:10.047910 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.048679 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.048681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:10.049452 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:10.049487 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.050210 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.050212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:10.050306 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:10.050344 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 08:02:10.050415 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 08:02:10.050472 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":17,"thread_start_us":122,"threads_started":1}
I20260809 08:02:10.051370 28809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318ea3f2870f4caabfeb3293f9373160" candidate_uuid: "5cd06a5d176749988ea32b8bff422ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed3c33f5bf74caba1c5f3d138614035" is_pre_election: true
I20260809 08:02:10.051368 28667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318ea3f2870f4caabfeb3293f9373160" candidate_uuid: "5cd06a5d176749988ea32b8bff422ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a256eb37658c48598b21cca32fe8542d" is_pre_election: true
I20260809 08:02:10.051663 28809 raft_consensus.cc:2454] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cd06a5d176749988ea32b8bff422ddd in term 0.
I20260809 08:02:10.051663 28667 raft_consensus.cc:2454] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cd06a5d176749988ea32b8bff422ddd in term 0.
I20260809 08:02:10.052173 28463 leader_election.cc:302] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cd06a5d176749988ea32b8bff422ddd, a256eb37658c48598b21cca32fe8542d; no voters:
I20260809 08:02:10.052475 28880 raft_consensus.cc:2781] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:10.052561 28880 raft_consensus.cc:482] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:10.052589 28880 raft_consensus.cc:3037] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:10.053613 28880 raft_consensus.cc:504] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:10.053960 28880 leader_election.cc:288] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [CANDIDATE]: Term 1 election: Requested vote from peers 5ed3c33f5bf74caba1c5f3d138614035 (127.8.51.67:45457), a256eb37658c48598b21cca32fe8542d (127.8.51.66:44075)
I20260809 08:02:10.054324 28809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318ea3f2870f4caabfeb3293f9373160" candidate_uuid: "5cd06a5d176749988ea32b8bff422ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed3c33f5bf74caba1c5f3d138614035"
I20260809 08:02:10.054430 28667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318ea3f2870f4caabfeb3293f9373160" candidate_uuid: "5cd06a5d176749988ea32b8bff422ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a256eb37658c48598b21cca32fe8542d"
I20260809 08:02:10.054500 28809 raft_consensus.cc:3037] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:10.054597 28667 raft_consensus.cc:3037] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:10.055862 28809 raft_consensus.cc:2454] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cd06a5d176749988ea32b8bff422ddd in term 1.
I20260809 08:02:10.055905 28667 raft_consensus.cc:2454] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cd06a5d176749988ea32b8bff422ddd in term 1.
I20260809 08:02:10.056169 28463 leader_election.cc:302] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cd06a5d176749988ea32b8bff422ddd, 5ed3c33f5bf74caba1c5f3d138614035; no voters:
I20260809 08:02:10.056360 28880 raft_consensus.cc:2781] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:10.056579 28880 raft_consensus.cc:686] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [term 1 LEADER]: Becoming Leader. State: Replica: 5cd06a5d176749988ea32b8bff422ddd, State: Running, Role: LEADER
I20260809 08:02:10.056902 28880 consensus_queue.cc:237] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } }
I20260809 08:02:10.060106 28383 catalog_manager.cc:5495] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cd06a5d176749988ea32b8bff422ddd (127.8.51.65). New cstate: current_term: 1 leader_uuid: "5cd06a5d176749988ea32b8bff422ddd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cd06a5d176749988ea32b8bff422ddd" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 33439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 } health_report { overall_health: UNKNOWN } } }
W20260809 08:02:10.089514 28718 tablet.cc:2369] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:10.122561 28871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.119139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49218 (local address 127.8.51.65:33439)
0809 08:02:10.119265 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:10.119269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:10.119282 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:10.119354 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:10.119356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:10.119412 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:10.119519 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:10.119793 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.120300 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.121226 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:10.121472 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:10.121563 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:10.121859 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:10.122241 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:10.122348 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:10.122424 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 08:02:10.122455 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:10.128448 28667 raft_consensus.cc:1261] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 1 FOLLOWER]: Refusing update from remote peer 5cd06a5d176749988ea32b8bff422ddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:10.128435 28809 raft_consensus.cc:1261] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 1 FOLLOWER]: Refusing update from remote peer 5cd06a5d176749988ea32b8bff422ddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:10.129155 28880 consensus_queue.cc:1035] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed3c33f5bf74caba1c5f3d138614035" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:10.129392 28885 consensus_queue.cc:1035] T 318ea3f2870f4caabfeb3293f9373160 P 5cd06a5d176749988ea32b8bff422ddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a256eb37658c48598b21cca32fe8542d" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:10.136770 28892 mvcc.cc:205] Tried to move back new op lower bound from 7316531323398815744 to 7316531323115446272. Current Snapshot: MvccSnapshot[applied={T|T < 7316531323398815744}]
I20260809 08:02:10.138651 28891 mvcc.cc:205] Tried to move back new op lower bound from 7316531323398815744 to 7316531323115446272. Current Snapshot: MvccSnapshot[applied={T|T < 7316531323398815744}]
I20260809 08:02:10.138793 28890 mvcc.cc:205] Tried to move back new op lower bound from 7316531323398815744 to 7316531323115446272. Current Snapshot: MvccSnapshot[applied={T|T < 7316531323398815744}]
I20260809 08:02:10.147089 28379 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:10.147256 28379 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:10.149549 28379 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f02ecf383624f688adb299cf5dff7ab: Sending DeleteTablet for 3 replicas of tablet 318ea3f2870f4caabfeb3293f9373160
I20260809 08:02:10.150360 28786 tablet_service.cc:1514] Processing DeleteTablet for tablet 318ea3f2870f4caabfeb3293f9373160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:10 UTC) from {username='slave'} at 127.0.0.1:39190
I20260809 08:02:10.150460 28647 tablet_service.cc:1514] Processing DeleteTablet for tablet 318ea3f2870f4caabfeb3293f9373160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:10 UTC) from {username='slave'} at 127.0.0.1:54158
I20260809 08:02:10.150887 28901 tablet_replica.cc:330] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: stopping tablet replica
I20260809 08:02:10.150990 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28447
I20260809 08:02:10.151116 28512 tablet_service.cc:1514] Processing DeleteTablet for tablet 318ea3f2870f4caabfeb3293f9373160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:10 UTC) from {username='slave'} at 127.0.0.1:49214
I20260809 08:02:10.152038 28901 raft_consensus.cc:2229] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:10.152305 28901 raft_consensus.cc:2258] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:10.153759 28900 tablet_replica.cc:330] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: stopping tablet replica
I20260809 08:02:10.154110 28900 raft_consensus.cc:2229] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:10.154332 28901 ts_tablet_manager.cc:1905] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:10.154552 28900 raft_consensus.cc:2258] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:10.156481 28900 ts_tablet_manager.cc:1905] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:10.157363 28901 ts_tablet_manager.cc:1918] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:10.157456 28901 log.cc:1196] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/318ea3f2870f4caabfeb3293f9373160
I20260809 08:02:10.157783 28901 ts_tablet_manager.cc:1939] T 318ea3f2870f4caabfeb3293f9373160 P a256eb37658c48598b21cca32fe8542d: Deleting consensus metadata
I20260809 08:02:10.159089 28367 catalog_manager.cc:4841] TS a256eb37658c48598b21cca32fe8542d (127.8.51.66:44075): tablet 318ea3f2870f4caabfeb3293f9373160 (table test-table [id=86358b7de7f34d6ca318cbcf213064a6]) successfully deleted
I20260809 08:02:10.160445 28900 ts_tablet_manager.cc:1918] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:10.160563 28900 log.cc:1196] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/318ea3f2870f4caabfeb3293f9373160
I20260809 08:02:10.160913 28900 ts_tablet_manager.cc:1939] T 318ea3f2870f4caabfeb3293f9373160 P 5ed3c33f5bf74caba1c5f3d138614035: Deleting consensus metadata
I20260809 08:02:10.161988 28367 catalog_manager.cc:4841] TS 5ed3c33f5bf74caba1c5f3d138614035 (127.8.51.67:45457): tablet 318ea3f2870f4caabfeb3293f9373160 (table test-table [id=86358b7de7f34d6ca318cbcf213064a6]) successfully deleted
W20260809 08:02:10.165855 28367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:33439 (error 108)
I20260809 08:02:10.166577 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28583
I20260809 08:02:10.166887 28869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:10.166567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:33439 (local address 127.0.0.1:49228)
0809 08:02:10.166730 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:10.166797 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 08:02:10.170691 28367 catalog_manager.cc:4584] TS 5cd06a5d176749988ea32b8bff422ddd (127.8.51.65:33439): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 318ea3f2870f4caabfeb3293f9373160: Network error: Client connection negotiation failed: client connection to 127.8.51.65:33439: connect: Connection refused (error 111)
I20260809 08:02:10.175096 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28720
I20260809 08:02:10.181348 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28352
2026-08-09T08:02:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1313 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:10 dist-test-slave-njxd krb5kdc[28905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:10 dist-test-slave-njxd krb5kdc[28905](info): set up 2 sockets
Aug 09 08:02:10 dist-test-slave-njxd krb5kdc[28905](info): commencing operation
krb5kdc: starting...
W20260809 08:02:11.238657 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:11.364450 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33035
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:41965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:33035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:11.475154 28918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:11.475440 28918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:11.475519 28918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:11.479425 28918 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:11.479507 28918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:11.479547 28918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:11.479605 28918 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:11.479643 28918 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:11.484877 28918 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:33035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:11.485958 28918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:11.486929 28918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:11.495364 28925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:11.495357 28923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:11.495602 28918 server_base.cc:1034] running on GCE node
W20260809 08:02:11.495643 28927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:11.496192 28918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:11.497179 28918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:11.498360 28918 hybrid_clock.cc:648] HybridClock initialized: now 1786262531498330 us; error 39 us; skew 500 ppm
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:11.501026 28918 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:11.501900 28918 webserver.cc:460] Webserver started at http://127.8.51.126:42497/ using document root <none> and password file <none>
I20260809 08:02:11.502415 28918 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:11.502512 28918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:11.502758 28918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:11.504595 28918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "cba8a775eef040bdbe4187fcf481dea5"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "a6f8186e98aca3097356a9c06a2e55e6"
server_key_iv: "3fe171d698b2d661da65fc250194a0d8"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.505146 28918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "cba8a775eef040bdbe4187fcf481dea5"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "a6f8186e98aca3097356a9c06a2e55e6"
server_key_iv: "3fe171d698b2d661da65fc250194a0d8"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.508708 28918 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 08:02:11.511130 28935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:11.512346 28918 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:02:11.512480 28918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "cba8a775eef040bdbe4187fcf481dea5"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "a6f8186e98aca3097356a9c06a2e55e6"
server_key_iv: "3fe171d698b2d661da65fc250194a0d8"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.512586 28918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:11.530912 28918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:11.534317 28918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:11.534533 28918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:11.541554 28918 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:33035
I20260809 08:02:11.541603 28991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:33035 every 8 connection(s)
I20260809 08:02:11.542548 28918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:11.545308 28992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:11.550845 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 28918
I20260809 08:02:11.550990 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:11.551136 28992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: Bootstrap starting.
I20260809 08:02:11.551317 8397 external_mini_cluster.cc:1428] Setting key 8cd23244b2868923597c83ea40047fcc
I20260809 08:02:11.553874 28992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:11.554744 28992 log.cc:824] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:11.556813 28992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: No bootstrap required, opened a new log
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:11.561307 28992 raft_consensus.cc:348] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } }
I20260809 08:02:11.561622 28992 raft_consensus.cc:374] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:11.561748 28992 raft_consensus.cc:729] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cba8a775eef040bdbe4187fcf481dea5, State: Initialized, Role: FOLLOWER
I20260809 08:02:11.562270 28992 consensus_queue.cc:260] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } }
I20260809 08:02:11.562479 28992 raft_consensus.cc:388] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:11.562572 28992 raft_consensus.cc:482] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:11.562714 28992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:11.563612 28992 raft_consensus.cc:504] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } }
I20260809 08:02:11.563956 28992 leader_election.cc:302] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cba8a775eef040bdbe4187fcf481dea5; no voters:
I20260809 08:02:11.564278 28992 leader_election.cc:288] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:11.564373 28997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:11.564617 28997 raft_consensus.cc:686] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [term 1 LEADER]: Becoming Leader. State: Replica: cba8a775eef040bdbe4187fcf481dea5, State: Running, Role: LEADER
I20260809 08:02:11.565011 28997 consensus_queue.cc:237] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } }
I20260809 08:02:11.565718 28992 sys_catalog.cc:564] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:11.566758 28999 sys_catalog.cc:455] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cba8a775eef040bdbe4187fcf481dea5. Latest consensus state: current_term: 1 leader_uuid: "cba8a775eef040bdbe4187fcf481dea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } } }
I20260809 08:02:11.566876 28999 sys_catalog.cc:458] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:11.567204 28998 sys_catalog.cc:455] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cba8a775eef040bdbe4187fcf481dea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cba8a775eef040bdbe4187fcf481dea5" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33035 } } }
I20260809 08:02:11.567314 28998 sys_catalog.cc:458] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:11.567342 29007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:11.567219 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:11.552665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33492 (local address 127.8.51.126:33035)
0809 08:02:11.553086 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:11.553105 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:11.553151 (+ 46us) server_negotiation.cc:407] Connection header received
0809 08:02:11.553862 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:11.553882 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:11.554276 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:11.554570 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:11.555508 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.556479 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.557680 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.558145 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.558278 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:11.561162 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:11.561167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:11.561180 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:11.561215 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:11.563276 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:11.563726 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:11.563733 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:11.563741 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:11.563886 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:11.564198 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:11.564201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:11.564203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:11.564753 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:11.564958 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:11.565645 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 08:02:11.565957 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":142,"threads_started":1}
I20260809 08:02:11.570904 29007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:11.576901 29007 catalog_manager.cc:1347] Generated new cluster ID: e7bc1a7a222049fe9a747290a4d5c7a3
I20260809 08:02:11.576973 29007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:11.592423 29007 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:11.593658 29007 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:11.598030 29007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: Generated new TSK 0
I20260809 08:02:11.598754 29007 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.51.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
Entry for principal kudu/127.8.51.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab.
I20260809 08:02:11.637138 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:41965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:11.747227 29019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:11.747560 29019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:11.747640 29019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:11.751618 29019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:11.751703 29019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:11.751789 29019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:11.756819 29019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.65.keytab
--principal=kudu/127.8.51.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:11.757869 29019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:11.758912 29019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:11.768741 29027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:11.768728 29025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:11.768724 29024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:11.768987 29019 server_base.cc:1034] running on GCE node
I20260809 08:02:11.769407 29019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:11.770094 29019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:11.771277 29019 hybrid_clock.cc:648] HybridClock initialized: now 1786262531771268 us; error 27 us; skew 500 ppm
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:11.774094 29019 init.cc:377] Logged in from keytab as kudu/127.8.51.65@KRBTEST.COM (short username kudu)
I20260809 08:02:11.774909 29019 webserver.cc:460] Webserver started at http://127.8.51.65:33853/ using document root <none> and password file <none>
I20260809 08:02:11.775548 29019 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:11.775640 29019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:11.775885 29019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:11.778180 29019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "c343339281f044d0ab23aec47f6a468d"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "693b40cfed0e0e5b2568f8e8de719b04"
server_key_iv: "8137b940e17dd24351c0cc7750c5e90b"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.778872 29019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "c343339281f044d0ab23aec47f6a468d"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "693b40cfed0e0e5b2568f8e8de719b04"
server_key_iv: "8137b940e17dd24351c0cc7750c5e90b"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.783000 29019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 08:02:11.785318 29036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:11.786758 29019 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:11.786883 29019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "c343339281f044d0ab23aec47f6a468d"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "693b40cfed0e0e5b2568f8e8de719b04"
server_key_iv: "8137b940e17dd24351c0cc7750c5e90b"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.786993 29019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:11.804045 29019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:11.807114 29019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:11.807276 29019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:11.807873 29019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:11.808706 29019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:11.808753 29019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:11.808820 29019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:11.808853 29019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:11.818117 29019 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:41633
I20260809 08:02:11.818133 29153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:41633 every 8 connection(s)
I20260809 08:02:11.819000 29019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:11.824362 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29019
I20260809 08:02:11.824512 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:11.824795 8397 external_mini_cluster.cc:1428] Setting key 43116ae5c72424710f42d2c2f45bb12e
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.65@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:11.833564 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:11.820756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:33333 (local address 127.8.51.126:33035)
0809 08:02:11.820886 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:11.820890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:11.821724 (+ 834us) server_negotiation.cc:407] Connection header received
0809 08:02:11.822947 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:11.822951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:11.823008 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:11.823109 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:11.824265 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.824906 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.826260 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.826501 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.826582 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:11.829681 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:11.829698 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:11.829701 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:11.829723 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:11.831368 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:11.831864 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:11.831871 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:11.831875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:11.831972 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:11.832299 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:11.832304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:11.832306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:11.832562 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:11.832677 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:11.833156 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 08:02:11.833316 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:02:11.834174 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:11.821110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33035 (local address 127.8.51.65:33333)
0809 08:02:11.821522 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:11.821562 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:11.822746 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:11.823277 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:11.823283 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:11.823607 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:11.824077 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:11.824115 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.825043 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.825046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:11.826149 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:11.826158 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:11.826664 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:11.826668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:11.826876 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:11.827415 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:11.827438 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:11.829447 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:11.831484 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:11.831489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:11.831500 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:11.831761 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:11.832068 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:11.832070 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:11.832071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:11.832198 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:11.832667 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:11.832672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:11.832887 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 08:02:11.833029 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 08:02:11.833284 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":108,"threads_started":1}
I20260809 08:02:11.835464 29154 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33035
I20260809 08:02:11.835703 29154 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.51.66@KRBTEST.COM; defaulting to no policy
I20260809 08:02:11.836220 29154 heartbeater.cc:511] Master 127.8.51.126:33035 requested a full tablet report, sending...
I20260809 08:02:11.837724 28953 ts_manager.cc:194] Registered new tserver with Master: c343339281f044d0ab23aec47f6a468d (127.8.51.65:41633)
I20260809 08:02:11.838902 28953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.65@KRBTEST.COM'} at 127.8.51.65:33333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
Entry for principal kudu/127.8.51.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab.
I20260809 08:02:11.856377 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:41965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:11.966389 29160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:11.966678 29160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:11.966748 29160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:11.970894 29160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:11.970979 29160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:11.971064 29160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:11.976364 29160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.66.keytab
--principal=kudu/127.8.51.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:11.977389 29160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:11.978422 29160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:11.987650 29169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:11.987697 29166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:11.987709 29167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:11.987816 29160 server_base.cc:1034] running on GCE node
I20260809 08:02:11.988232 29160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:11.988897 29160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:11.990082 29160 hybrid_clock.cc:648] HybridClock initialized: now 1786262531990071 us; error 37 us; skew 500 ppm
Aug 09 08:02:11 dist-test-slave-njxd krb5kdc[28905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:11.992873 29160 init.cc:377] Logged in from keytab as kudu/127.8.51.66@KRBTEST.COM (short username kudu)
I20260809 08:02:11.993654 29160 webserver.cc:460] Webserver started at http://127.8.51.66:39925/ using document root <none> and password file <none>
I20260809 08:02:11.994134 29160 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:11.994189 29160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:11.994341 29160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:11.996256 29160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "4e42d90f99e34b95a0526fce240b41ac"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "ea8f70fbb2d14be6e2879f4d692d1e55"
server_key_iv: "d47dacf090f707a648bb9826ad5d463e"
server_key_version: "encryptionkey@0"
I20260809 08:02:11.996743 29160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "4e42d90f99e34b95a0526fce240b41ac"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "ea8f70fbb2d14be6e2879f4d692d1e55"
server_key_iv: "d47dacf090f707a648bb9826ad5d463e"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.000167 29160 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 08:02:12.002540 29176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.003801 29160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:12.003973 29160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "4e42d90f99e34b95a0526fce240b41ac"
format_stamp: "Formatted at 2026-08-09 08:02:11 on dist-test-slave-njxd"
server_key: "ea8f70fbb2d14be6e2879f4d692d1e55"
server_key_iv: "d47dacf090f707a648bb9826ad5d463e"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.004107 29160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:12.014546 29160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:12.017542 29160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:12.017838 29160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:12.018425 29160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:12.019217 29160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:12.019270 29160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.019310 29160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:12.019331 29160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.027951 29160 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:37491
I20260809 08:02:12.027972 29295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:37491 every 8 connection(s)
I20260809 08:02:12.028842 29160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:12.032969 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29160
I20260809 08:02:12.033105 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:12.033404 8397 external_mini_cluster.cc:1428] Setting key c0a55ad198fb61ccc8adb5674307347f
Aug 09 08:02:12 dist-test-slave-njxd krb5kdc[28905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262531, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.66@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:12.043588 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.030655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:49993 (local address 127.8.51.126:33035)
0809 08:02:12.030808 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.030812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.031604 (+ 792us) server_negotiation.cc:407] Connection header received
0809 08:02:12.032891 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.032894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.032953 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.033066 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:12.034508 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.035138 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.036270 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.036518 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.036630 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.039724 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:12.039728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:12.039730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:12.039761 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:12.041245 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.041916 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.041918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.041919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.041994 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.042373 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.042375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.042376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.042538 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:12.042613 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.043353 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.043466 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.8.51.67@KRBTEST.COM; defaulting to no policy
I20260809 08:02:12.044621 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.031003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33035 (local address 127.8.51.66:49993)
0809 08:02:12.031445 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.031486 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.032667 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.033333 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.033340 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.033808 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:12.034361 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.034374 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.035266 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.035270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.036134 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.036143 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.036667 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.036671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.036903 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.037543 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:12.037569 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:12.039550 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:12.041367 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:12.041377 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:12.041393 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:12.041814 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:12.042091 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:12.042095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:12.042098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:12.042276 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:12.042640 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:12.042651 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:12.042979 (+ 328us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.043188 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.043524 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":119,"threads_started":1}
I20260809 08:02:12.045887 29296 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33035
I20260809 08:02:12.046141 29296 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:12.046554 29296 heartbeater.cc:511] Master 127.8.51.126:33035 requested a full tablet report, sending...
I20260809 08:02:12.047504 28953 ts_manager.cc:194] Registered new tserver with Master: 4e42d90f99e34b95a0526fce240b41ac (127.8.51.66:37491)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.67@KRBTEST.COM" created.
I20260809 08:02:12.048285 28953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.66@KRBTEST.COM'} at 127.8.51.66:49993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
Entry for principal kudu/127.8.51.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab.
I20260809 08:02:12.064498 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:41965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:12.173250 29301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:12.173488 29301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:12.173530 29301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:12.177604 29301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:12.177652 29301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:12.177758 29301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:12.182744 29301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.67.keytab
--principal=kudu/127.8.51.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:33035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:12.183725 29301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:12.184850 29301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:12.194392 29307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.194392 29310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.194490 29306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:12.194553 29301 server_base.cc:1034] running on GCE node
I20260809 08:02:12.194983 29301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:12.195529 29301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:12.196709 29301 hybrid_clock.cc:648] HybridClock initialized: now 1786262532196696 us; error 27 us; skew 500 ppm
Aug 09 08:02:12 dist-test-slave-njxd krb5kdc[28905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262532, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:12.199656 29301 init.cc:377] Logged in from keytab as kudu/127.8.51.67@KRBTEST.COM (short username kudu)
I20260809 08:02:12.200546 29301 webserver.cc:460] Webserver started at http://127.8.51.67:41121/ using document root <none> and password file <none>
I20260809 08:02:12.201102 29301 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:12.201196 29301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:12.201431 29301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:12.203467 29301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "591a07a4104843afb1b3a2ba7052b4b3"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "9601533311d839c727a5f2cecdfdd54c"
server_key_iv: "f5e2881ddc249fb74496be70011dce3d"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.204021 29301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "591a07a4104843afb1b3a2ba7052b4b3"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "9601533311d839c727a5f2cecdfdd54c"
server_key_iv: "f5e2881ddc249fb74496be70011dce3d"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.207669 29301 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 08:02:12.210101 29317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.211289 29301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:12.211428 29301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "591a07a4104843afb1b3a2ba7052b4b3"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "9601533311d839c727a5f2cecdfdd54c"
server_key_iv: "f5e2881ddc249fb74496be70011dce3d"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.211537 29301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:12.226126 29301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:12.228832 29301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:12.229031 29301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:12.229636 29301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:12.230506 29301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:12.230579 29301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.230647 29301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:12.230706 29301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.239377 29301 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:33335
I20260809 08:02:12.239410 29435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:33335 every 8 connection(s)
I20260809 08:02:12.240280 29301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:02:12.240926 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29301
I20260809 08:02:12.241051 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:12.241345 8397 external_mini_cluster.cc:1428] Setting key bc2b79193bf213ed0d8fd8e4e7d7ff66
Aug 09 08:02:12 dist-test-slave-njxd krb5kdc[28905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262532, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.67@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:12.254113 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.242239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:38205 (local address 127.8.51.126:33035)
0809 08:02:12.242370 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.242374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.243382 (+ 1008us) server_negotiation.cc:407] Connection header received
0809 08:02:12.244797 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.244801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.244854 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.244934 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:12.246187 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.246722 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.247894 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.248126 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.248238 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.250696 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:12.250700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:12.250703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:12.250735 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:12.251956 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.252477 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.252481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.252483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.252569 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.252925 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.252930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.252931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.253137 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:12.253251 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.253804 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.253930 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 08:02:12.255091 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.242755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33035 (local address 127.8.51.67:38205)
0809 08:02:12.243238 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.243290 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.244573 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.245113 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.245119 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.245488 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:12.246041 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.246055 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.246863 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.246867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.247754 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.247762 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.248282 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.248286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.248458 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.249029 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:12.249045 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:12.250512 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:12.252079 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:12.252085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:12.252101 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:12.252363 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:12.252679 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:12.252682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:12.252684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:12.252825 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:12.253252 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:12.253259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:12.253496 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.253759 (+ 263us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.254085 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":148,"threads_started":1}
I20260809 08:02:12.256237 29436 heartbeater.cc:347] Connected to a master server at 127.8.51.126:33035
I20260809 08:02:12.256484 29436 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:12.256973 29436 heartbeater.cc:511] Master 127.8.51.126:33035 requested a full tablet report, sending...
I20260809 08:02:12.257958 28953 ts_manager.cc:194] Registered new tserver with Master: 591a07a4104843afb1b3a2ba7052b4b3 (127.8.51.67:33335)
I20260809 08:02:12.258545 28953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.51.67@KRBTEST.COM'} at 127.8.51.67:38205
I20260809 08:02:12.266983 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:12.276494 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.268950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33494 (local address 127.8.51.126:33035)
0809 08:02:12.269096 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.269101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.269289 (+ 188us) server_negotiation.cc:407] Connection header received
0809 08:02:12.269420 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.269423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.269471 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.269557 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:12.270259 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.270765 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.271593 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.271816 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.271922 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.273245 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:12.273251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:12.273258 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:12.273282 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:12.274805 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.275201 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.275203 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.275204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.275285 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:12.275520 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:12.275522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:12.275523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:12.275746 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:12.275850 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.276122 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.276280 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 08:02:12.279304 28953 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33494:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:12.282341 28953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:12.296497 29447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.290250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41633 (local address 127.0.0.1:51774)
0809 08:02:12.290580 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.290649 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.290775 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.292231 (+ 1456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.292240 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.292269 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:12.292418 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.292425 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.293886 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.293889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.295043 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.295052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.296168 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.296174 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.296263 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.296283 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.296349 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.296404 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260809 08:02:12.296638 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.291781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43892 (local address 127.8.51.66:37491)
0809 08:02:12.292179 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.292191 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.292214 (+ 23us) server_negotiation.cc:407] Connection header received
0809 08:02:12.292289 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.292294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.292478 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.292630 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:12.292811 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.294057 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.295232 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.295772 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.295893 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.296038 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.296367 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.296476 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":148,"threads_started":1}
I20260809 08:02:12.296861 29451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.291271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51774 (local address 127.8.51.65:41633)
0809 08:02:12.291695 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.291713 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.291740 (+ 27us) server_negotiation.cc:407] Connection header received
0809 08:02:12.291824 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.291845 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.292044 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.292220 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:12.292516 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.293738 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.295164 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.295999 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.296144 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.296275 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.296565 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.296678 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":87,"threads_started":1}
I20260809 08:02:12.296487 29448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.290345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:37491 (local address 127.0.0.1:43892)
0809 08:02:12.290941 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.290988 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.291070 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.292600 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.292606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.292629 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:12.292718 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.292725 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.294204 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.294207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.295076 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.295085 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.295904 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.295908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.296021 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.296065 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.296208 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.296331 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":17,"thread_start_us":95,"threads_started":1}
I20260809 08:02:12.298126 29450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.291131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.8.51.67:33335)
0809 08:02:12.291476 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.291490 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.292285 (+ 795us) server_negotiation.cc:407] Connection header received
0809 08:02:12.292697 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.292704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.292892 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.292986 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:12.293314 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.294299 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.296459 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.297258 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.297338 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.297476 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.297880 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.297981 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":110,"threads_started":1}
I20260809 08:02:12.298573 29449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.290970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:33335 (local address 127.0.0.1:50968)
0809 08:02:12.292189 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.292203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.292346 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.293127 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.293129 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.293143 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:12.293201 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.293204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.294450 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.294455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.296320 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.296334 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.297592 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.297599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.297713 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.297742 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.298377 (+ 635us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.298459 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1128,"mutex_wait_us":27,"thread_start_us":85,"threads_started":1}
I20260809 08:02:12.299993 29227 tablet_service.cc:1467] Processing CreateTablet for tablet a65fd4e4201f4b66803deb73d6106a5c (DEFAULT_TABLE table=test-table [id=5b624957c564419290390f9b7072918c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:12.299991 29085 tablet_service.cc:1467] Processing CreateTablet for tablet a65fd4e4201f4b66803deb73d6106a5c (DEFAULT_TABLE table=test-table [id=5b624957c564419290390f9b7072918c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:12.301149 29085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65fd4e4201f4b66803deb73d6106a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:12.301149 29227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65fd4e4201f4b66803deb73d6106a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:12.301122 29368 tablet_service.cc:1467] Processing CreateTablet for tablet a65fd4e4201f4b66803deb73d6106a5c (DEFAULT_TABLE table=test-table [id=5b624957c564419290390f9b7072918c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:12.302155 29368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65fd4e4201f4b66803deb73d6106a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:12.308075 29453 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Bootstrap starting.
I20260809 08:02:12.308754 29454 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: Bootstrap starting.
I20260809 08:02:12.308957 29455 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Bootstrap starting.
I20260809 08:02:12.311000 29454 tablet_bootstrap.cc:654] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:12.310999 29453 tablet_bootstrap.cc:654] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:12.311265 29455 tablet_bootstrap.cc:654] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:12.312199 29455 log.cc:824] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:12.312283 29454 log.cc:824] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:12.312283 29453 log.cc:824] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:12.314088 29455 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: No bootstrap required, opened a new log
I20260809 08:02:12.314210 29454 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: No bootstrap required, opened a new log
I20260809 08:02:12.314229 29453 tablet_bootstrap.cc:492] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: No bootstrap required, opened a new log
I20260809 08:02:12.314319 29455 ts_tablet_manager.cc:1397] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:12.314392 29454 ts_tablet_manager.cc:1397] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260809 08:02:12.314392 29453 ts_tablet_manager.cc:1397] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 08:02:12.317929 29455 raft_consensus.cc:348] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.318259 29455 raft_consensus.cc:374] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:12.318347 29455 raft_consensus.cc:729] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42d90f99e34b95a0526fce240b41ac, State: Initialized, Role: FOLLOWER
I20260809 08:02:12.318343 29454 raft_consensus.cc:348] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.318343 29453 raft_consensus.cc:348] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.318624 29453 raft_consensus.cc:374] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:12.318661 29454 raft_consensus.cc:374] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:12.318717 29453 raft_consensus.cc:729] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591a07a4104843afb1b3a2ba7052b4b3, State: Initialized, Role: FOLLOWER
I20260809 08:02:12.318734 29454 raft_consensus.cc:729] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c343339281f044d0ab23aec47f6a468d, State: Initialized, Role: FOLLOWER
I20260809 08:02:12.318866 29455 consensus_queue.cc:260] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.319208 29454 consensus_queue.cc:260] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.319208 29453 consensus_queue.cc:260] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.319618 29296 heartbeater.cc:503] Master 127.8.51.126:33035 was elected leader, sending a full tablet report...
I20260809 08:02:12.320199 29454 ts_tablet_manager.cc:1428] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260809 08:02:12.320205 29453 ts_tablet_manager.cc:1428] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260809 08:02:12.320551 29154 heartbeater.cc:503] Master 127.8.51.126:33035 was elected leader, sending a full tablet report...
I20260809 08:02:12.320964 29436 heartbeater.cc:503] Master 127.8.51.126:33035 was elected leader, sending a full tablet report...
I20260809 08:02:12.321009 29455 ts_tablet_manager.cc:1428] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 08:02:12.345526 29460 raft_consensus.cc:482] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:02:12.345803 29460 raft_consensus.cc:504] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.347067 29460 leader_election.cc:288] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c343339281f044d0ab23aec47f6a468d (127.8.51.65:41633), 4e42d90f99e34b95a0526fce240b41ac (127.8.51.66:37491)
I20260809 08:02:12.352144 29451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.347380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:52149 (local address 127.8.51.65:41633)
0809 08:02:12.347500 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.347504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.347600 (+ 96us) server_negotiation.cc:407] Connection header received
0809 08:02:12.347775 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.347779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.347833 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.347931 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:12.348254 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.349061 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.350942 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.351564 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.351656 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.351731 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.351928 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.352011 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 08:02:12.352133 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.347271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41633 (local address 127.8.51.67:52149)
0809 08:02:12.347483 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.347499 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.347628 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.347968 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.347972 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.347991 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:12.348133 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.348143 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.349198 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.349203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.350819 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.350826 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.351668 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.351671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.351801 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.351830 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.351897 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.351950 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":316}
I20260809 08:02:12.352144 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.347485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:46949 (local address 127.8.51.66:37491)
0809 08:02:12.347624 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.347628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.347897 (+ 269us) server_negotiation.cc:407] Connection header received
0809 08:02:12.348014 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.348020 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.348070 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.348127 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:12.348407 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.349119 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.350796 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.351448 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.351577 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.351659 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.351917 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.352020 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:12.352149 29462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.347354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:37491 (local address 127.8.51.67:46949)
0809 08:02:12.347793 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.347804 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.347920 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.348156 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.348160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.348180 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:12.348297 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.348302 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.349213 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.349216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.350689 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.350700 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.351597 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.351601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.351730 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.351783 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.351866 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.351945 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":101,"thread_start_us":150,"threads_started":1}
I20260809 08:02:12.352885 29249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65fd4e4201f4b66803deb73d6106a5c" candidate_uuid: "591a07a4104843afb1b3a2ba7052b4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42d90f99e34b95a0526fce240b41ac" is_pre_election: true
I20260809 08:02:12.352979 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65fd4e4201f4b66803deb73d6106a5c" candidate_uuid: "591a07a4104843afb1b3a2ba7052b4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c343339281f044d0ab23aec47f6a468d" is_pre_election: true
I20260809 08:02:12.353238 29249 raft_consensus.cc:2454] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591a07a4104843afb1b3a2ba7052b4b3 in term 0.
I20260809 08:02:12.353305 29108 raft_consensus.cc:2454] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591a07a4104843afb1b3a2ba7052b4b3 in term 0.
I20260809 08:02:12.353773 29321 leader_election.cc:302] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42d90f99e34b95a0526fce240b41ac, 591a07a4104843afb1b3a2ba7052b4b3; no voters:
I20260809 08:02:12.354063 29460 raft_consensus.cc:2781] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:12.354148 29460 raft_consensus.cc:482] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:12.354192 29460 raft_consensus.cc:3037] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:12.355245 29460 raft_consensus.cc:504] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.355578 29460 leader_election.cc:288] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [CANDIDATE]: Term 1 election: Requested vote from peers c343339281f044d0ab23aec47f6a468d (127.8.51.65:41633), 4e42d90f99e34b95a0526fce240b41ac (127.8.51.66:37491)
I20260809 08:02:12.355898 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65fd4e4201f4b66803deb73d6106a5c" candidate_uuid: "591a07a4104843afb1b3a2ba7052b4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c343339281f044d0ab23aec47f6a468d"
I20260809 08:02:12.355958 29249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65fd4e4201f4b66803deb73d6106a5c" candidate_uuid: "591a07a4104843afb1b3a2ba7052b4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42d90f99e34b95a0526fce240b41ac"
I20260809 08:02:12.356032 29108 raft_consensus.cc:3037] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:12.356102 29249 raft_consensus.cc:3037] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:12.357116 29249 raft_consensus.cc:2454] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591a07a4104843afb1b3a2ba7052b4b3 in term 1.
I20260809 08:02:12.357120 29108 raft_consensus.cc:2454] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591a07a4104843afb1b3a2ba7052b4b3 in term 1.
I20260809 08:02:12.357417 29321 leader_election.cc:302] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42d90f99e34b95a0526fce240b41ac, 591a07a4104843afb1b3a2ba7052b4b3; no voters:
I20260809 08:02:12.357626 29460 raft_consensus.cc:2781] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:12.357841 29460 raft_consensus.cc:686] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 591a07a4104843afb1b3a2ba7052b4b3, State: Running, Role: LEADER
I20260809 08:02:12.358178 29460 consensus_queue.cc:237] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } }
I20260809 08:02:12.361346 28951 catalog_manager.cc:5495] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591a07a4104843afb1b3a2ba7052b4b3 (127.8.51.67). New cstate: current_term: 1 leader_uuid: "591a07a4104843afb1b3a2ba7052b4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591a07a4104843afb1b3a2ba7052b4b3" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 33335 } health_report { overall_health: HEALTHY } } }
I20260809 08:02:12.374042 29450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.370860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50974 (local address 127.8.51.67:33335)
0809 08:02:12.370979 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.370988 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.371001 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:12.371122 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.371124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.371176 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.371265 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:12.371472 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.371968 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.372734 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.372925 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.372996 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.373233 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:12.373698 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:12.373793 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.373842 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.373888 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:12.380057 29249 raft_consensus.cc:1261] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 1 FOLLOWER]: Refusing update from remote peer 591a07a4104843afb1b3a2ba7052b4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:12.380074 29108 raft_consensus.cc:1261] T a65fd4e4201f4b66803deb73d6106a5c P c343339281f044d0ab23aec47f6a468d [term 1 FOLLOWER]: Refusing update from remote peer 591a07a4104843afb1b3a2ba7052b4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:12.380772 29463 consensus_queue.cc:1035] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42d90f99e34b95a0526fce240b41ac" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 37491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:12.381012 29460 consensus_queue.cc:1035] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c343339281f044d0ab23aec47f6a468d" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:12.389181 29469 mvcc.cc:205] Tried to move back new op lower bound from 7316531332621217792 to 7316531332541886464. Current Snapshot: MvccSnapshot[applied={T|T < 7316531332621217792}]
I20260809 08:02:12.397497 28951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:12.397725 28951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:12.400277 28951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cba8a775eef040bdbe4187fcf481dea5: Sending DeleteTablet for 3 replicas of tablet a65fd4e4201f4b66803deb73d6106a5c
I20260809 08:02:12.401084 29368 tablet_service.cc:1514] Processing DeleteTablet for tablet a65fd4e4201f4b66803deb73d6106a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:50968
I20260809 08:02:12.401108 29085 tablet_service.cc:1514] Processing DeleteTablet for tablet a65fd4e4201f4b66803deb73d6106a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:51774
I20260809 08:02:12.401172 29227 tablet_service.cc:1514] Processing DeleteTablet for tablet a65fd4e4201f4b66803deb73d6106a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:12 UTC) from {username='kudu', principal='kudu/127.8.51.126@KRBTEST.COM'} at 127.0.0.1:43892
I20260809 08:02:12.401698 29477 tablet_replica.cc:330] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: stopping tablet replica
I20260809 08:02:12.401908 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29019
I20260809 08:02:12.402056 29477 raft_consensus.cc:2229] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:12.402551 29477 raft_consensus.cc:2258] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:12.404675 29479 tablet_replica.cc:330] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: stopping tablet replica
I20260809 08:02:12.404740 29477 ts_tablet_manager.cc:1905] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:12.405009 29479 raft_consensus.cc:2229] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 08:02:12.405448 29479 raft_consensus.cc:2258] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:12.406782 29479 ts_tablet_manager.cc:1905] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:12.408984 29477 ts_tablet_manager.cc:1918] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:12.409133 29477 log.cc:1196] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/a65fd4e4201f4b66803deb73d6106a5c
I20260809 08:02:12.409533 29477 ts_tablet_manager.cc:1939] T a65fd4e4201f4b66803deb73d6106a5c P 4e42d90f99e34b95a0526fce240b41ac: Deleting consensus metadata
I20260809 08:02:12.409719 29479 ts_tablet_manager.cc:1918] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:12.409852 29479 log.cc:1196] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/a65fd4e4201f4b66803deb73d6106a5c
I20260809 08:02:12.410210 29479 ts_tablet_manager.cc:1939] T a65fd4e4201f4b66803deb73d6106a5c P 591a07a4104843afb1b3a2ba7052b4b3: Deleting consensus metadata
I20260809 08:02:12.410926 28939 catalog_manager.cc:4841] TS 4e42d90f99e34b95a0526fce240b41ac (127.8.51.66:37491): tablet a65fd4e4201f4b66803deb73d6106a5c (table test-table [id=5b624957c564419290390f9b7072918c]) successfully deleted
I20260809 08:02:12.411331 28939 catalog_manager.cc:4841] TS 591a07a4104843afb1b3a2ba7052b4b3 (127.8.51.67:33335): tablet a65fd4e4201f4b66803deb73d6106a5c (table test-table [id=5b624957c564419290390f9b7072918c]) successfully deleted
W20260809 08:02:12.412101 28938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:41633 (error 108)
I20260809 08:02:12.412926 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29160
I20260809 08:02:12.413180 29449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.412877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:41633 (local address 127.0.0.1:51784)
0809 08:02:12.413011 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.413084 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 08:02:12.415702 28938 catalog_manager.cc:4584] TS c343339281f044d0ab23aec47f6a468d (127.8.51.65:41633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a65fd4e4201f4b66803deb73d6106a5c: Network error: Client connection negotiation failed: client connection to 127.8.51.65:41633: connect: Connection refused (error 111)
I20260809 08:02:12.422948 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29301
I20260809 08:02:12.429891 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 28918
2026-08-09T08:02:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2251 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T08:02:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:12Z Disabled control of system clock
I20260809 08:02:12.462517 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41011
--webserver_interface=127.8.51.126
--webserver_port=0
--builtin_ntp_servers=127.8.51.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:41011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:12.571282 29484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:12.571532 29484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:12.571563 29484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:12.575523 29484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:12.575572 29484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:12.575587 29484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:12.575603 29484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:12.575618 29484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:12.580765 29484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:41011
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:12.581795 29484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:12.583145 29484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:12.591218 29484 server_base.cc:1034] running on GCE node
W20260809 08:02:12.591181 29489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.591215 29490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.591174 29492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:12.592043 29484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:12.593076 29484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:12.594256 29484 hybrid_clock.cc:648] HybridClock initialized: now 1786262532594243 us; error 25 us; skew 500 ppm
I20260809 08:02:12.596063 29484 webserver.cc:460] Webserver started at http://127.8.51.126:41967/ using document root <none> and password file <none>
I20260809 08:02:12.596612 29484 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:12.596706 29484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:12.596932 29484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:12.599097 29484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "03f42e7b4e61486b986c11b70bca04ee"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "22d12c9a610533934ee09064bc870dcf"
server_key_iv: "e4e3d787b4b601fcf0a843ef14c61c95"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.599648 29484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "03f42e7b4e61486b986c11b70bca04ee"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "22d12c9a610533934ee09064bc870dcf"
server_key_iv: "e4e3d787b4b601fcf0a843ef14c61c95"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.603196 29484 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 08:02:12.605427 29500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.606662 29484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:12.606799 29484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "03f42e7b4e61486b986c11b70bca04ee"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "22d12c9a610533934ee09064bc870dcf"
server_key_iv: "e4e3d787b4b601fcf0a843ef14c61c95"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.606907 29484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:12.639161 29484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:12.639914 29484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:12.640115 29484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:12.647265 29484 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:41011
I20260809 08:02:12.647280 29553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:41011 every 8 connection(s)
I20260809 08:02:12.648219 29484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:12.651503 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:12.657107 29554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: Bootstrap starting.
I20260809 08:02:12.658097 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29484
I20260809 08:02:12.658234 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:12.658604 8397 external_mini_cluster.cc:1428] Setting key 08fb06b04b2f19b964caba4e96ad27e5
I20260809 08:02:12.660267 29554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:12.661015 29554 log.cc:824] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:12.663046 29554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: No bootstrap required, opened a new log
I20260809 08:02:12.666515 29554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } }
I20260809 08:02:12.666719 29554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:12.666850 29554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f42e7b4e61486b986c11b70bca04ee, State: Initialized, Role: FOLLOWER
I20260809 08:02:12.667397 29554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } }
I20260809 08:02:12.667557 29554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:12.667644 29554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:12.667766 29554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:12.667881 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.659829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57800 (local address 127.8.51.126:41011)
0809 08:02:12.660536 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.660551 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.660587 (+ 36us) server_negotiation.cc:407] Connection header received
0809 08:02:12.661267 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.661285 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.661803 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.662181 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:12.662605 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.663591 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.664533 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.665016 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.665193 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.666073 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:12.666086 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:12.666098 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:12.666468 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:12.666522 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:12.666542 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:12.666652 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.666838 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.667065 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":143,"threads_started":1}
I20260809 08:02:12.668900 29554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } }
I20260809 08:02:12.669251 29554 leader_election.cc:302] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f42e7b4e61486b986c11b70bca04ee; no voters:
I20260809 08:02:12.669580 29554 leader_election.cc:288] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:12.669672 29559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:12.669890 29559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [term 1 LEADER]: Becoming Leader. State: Replica: 03f42e7b4e61486b986c11b70bca04ee, State: Running, Role: LEADER
I20260809 08:02:12.670773 29559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } }
I20260809 08:02:12.671026 29554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:12.672590 29561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f42e7b4e61486b986c11b70bca04ee. Latest consensus state: current_term: 1 leader_uuid: "03f42e7b4e61486b986c11b70bca04ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } } }
I20260809 08:02:12.672569 29560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03f42e7b4e61486b986c11b70bca04ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f42e7b4e61486b986c11b70bca04ee" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41011 } } }
I20260809 08:02:12.672737 29561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:12.672757 29560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:12.676067 29575 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:12.676157 29575 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:12.676213 29573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:12.677073 29573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:12.682504 29573 catalog_manager.cc:1347] Generated new cluster ID: 62eb896cad204e4383f3e227ef8b8883
I20260809 08:02:12.682567 29573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:12.703649 29573 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:12.704545 29573 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:12.708890 29573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: Generated new TSK 0
I20260809 08:02:12.709518 29573 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:12.722733 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.65:0
--local_ip_for_outbound_sockets=127.8.51.65
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--builtin_ntp_servers=127.8.51.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 08:02:12.834344 29580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:12.834692 29580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:12.834750 29580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:12.838682 29580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:12.838725 29580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:12.838776 29580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.65
I20260809 08:02:12.843050 29580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.51.65
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.65
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:12.843935 29580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:12.845197 29580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:12.854884 29588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.854895 29587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:12.854898 29590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:12.855337 29580 server_base.cc:1034] running on GCE node
I20260809 08:02:12.855747 29580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:12.856360 29580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:12.857517 29580 hybrid_clock.cc:648] HybridClock initialized: now 1786262532857489 us; error 47 us; skew 500 ppm
I20260809 08:02:12.859318 29580 webserver.cc:460] Webserver started at http://127.8.51.65:44383/ using document root <none> and password file <none>
I20260809 08:02:12.859913 29580 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:12.859975 29580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:12.860229 29580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:12.862409 29580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data/instance:
uuid: "17138e59006c4b7e8778121b0cc91e75"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "5dba296a12475a9bd671844ed650c9bb"
server_key_iv: "6e7a94f1f3595a541414c6ca8214a634"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.863057 29580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance:
uuid: "17138e59006c4b7e8778121b0cc91e75"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "5dba296a12475a9bd671844ed650c9bb"
server_key_iv: "6e7a94f1f3595a541414c6ca8214a634"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.866606 29580 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:02:12.868887 29596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.870160 29580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:12.870306 29580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal
uuid: "17138e59006c4b7e8778121b0cc91e75"
format_stamp: "Formatted at 2026-08-09 08:02:12 on dist-test-slave-njxd"
server_key: "5dba296a12475a9bd671844ed650c9bb"
server_key_iv: "6e7a94f1f3595a541414c6ca8214a634"
server_key_version: "encryptionkey@0"
I20260809 08:02:12.870453 29580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:12.886099 29580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:12.886695 29580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:12.886876 29580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:12.887411 29580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:12.888248 29580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:12.888314 29580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.888393 29580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:12.888434 29580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:12.897284 29580 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.65:34197
I20260809 08:02:12.897310 29724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.65:34197 every 8 connection(s)
I20260809 08:02:12.898232 29580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/data/info.pb
I20260809 08:02:12.899622 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29580
I20260809 08:02:12.899741 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-0/wal/instance
I20260809 08:02:12.900094 8397 external_mini_cluster.cc:1428] Setting key 77900340386d70b1fc5bae64fc7ae391
I20260809 08:02:12.902119 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.66:0
--local_ip_for_outbound_sockets=127.8.51.66
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--builtin_ntp_servers=127.8.51.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:12.908494 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.900055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:57841 (local address 127.8.51.126:41011)
0809 08:02:12.900194 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:12.900199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:12.901350 (+ 1151us) server_negotiation.cc:407] Connection header received
0809 08:02:12.903411 (+ 2061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:12.903413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:12.903457 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:12.903525 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:12.904601 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.905166 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.906362 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.906793 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.906932 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.907948 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:12.907954 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:12.907959 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:12.907976 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:12.908003 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:12.908017 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:12.908099 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:12.908235 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 08:02:12.908306 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 08:02:12.909211 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:12.900531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:41011 (local address 127.8.51.65:57841)
0809 08:02:12.901209 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:12.901256 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:12.903178 (+ 1922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:12.903730 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:12.903741 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:12.903848 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:12.904434 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.904447 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.905309 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.905312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.906221 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:12.906231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:12.906951 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:12.906954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:12.907081 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:12.907680 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:12.907681 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:12.907728 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:12.907797 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:12.908104 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:12.908110 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:12.908114 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 08:02:12.908201 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 08:02:12.908388 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":149,"threads_started":1}
I20260809 08:02:12.910483 29725 heartbeater.cc:347] Connected to a master server at 127.8.51.126:41011
I20260809 08:02:12.910748 29725 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:12.911408 29725 heartbeater.cc:511] Master 127.8.51.126:41011 requested a full tablet report, sending...
I20260809 08:02:12.912876 29517 ts_manager.cc:194] Registered new tserver with Master: 17138e59006c4b7e8778121b0cc91e75 (127.8.51.65:34197)
I20260809 08:02:12.914024 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.65:57841
W20260809 08:02:13.013019 29728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:13.013279 29728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:13.013317 29728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:13.017218 29728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:13.017272 29728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:13.017343 29728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.66
I20260809 08:02:13.021988 29728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.51.66
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.66
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:13.023012 29728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:13.024423 29728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:13.034132 29737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:13.034144 29735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:13.034180 29728 server_base.cc:1034] running on GCE node
W20260809 08:02:13.034127 29734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:13.034883 29728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:13.035516 29728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:13.036675 29728 hybrid_clock.cc:648] HybridClock initialized: now 1786262533036660 us; error 26 us; skew 500 ppm
I20260809 08:02:13.038601 29728 webserver.cc:460] Webserver started at http://127.8.51.66:43455/ using document root <none> and password file <none>
I20260809 08:02:13.039191 29728 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:13.039255 29728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:13.039486 29728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:13.041481 29728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data/instance:
uuid: "b17d36cb366a4607883ace015cdedb6e"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "410e72907be8c238c82a7a214e76d003"
server_key_iv: "ead8b6e6f884dec1853a5a39c9157256"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.042083 29728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance:
uuid: "b17d36cb366a4607883ace015cdedb6e"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "410e72907be8c238c82a7a214e76d003"
server_key_iv: "ead8b6e6f884dec1853a5a39c9157256"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.045564 29728 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:13.047789 29744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.048954 29728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:13.049082 29728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal
uuid: "b17d36cb366a4607883ace015cdedb6e"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "410e72907be8c238c82a7a214e76d003"
server_key_iv: "ead8b6e6f884dec1853a5a39c9157256"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.049196 29728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:13.081177 29728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:13.081982 29728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:13.082194 29728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:13.082800 29728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:13.083755 29728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:13.083827 29728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.083899 29728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:13.083950 29728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.092394 29728 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.66:38787
I20260809 08:02:13.092424 29863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.66:38787 every 8 connection(s)
I20260809 08:02:13.093284 29728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/data/info.pb
I20260809 08:02:13.100287 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29728
I20260809 08:02:13.100410 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal/instance
I20260809 08:02:13.100755 8397 external_mini_cluster.cc:1428] Setting key 6b2458ba51c2e812e200500b645cfa29
I20260809 08:02:13.102349 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.095041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.66:53017 (local address 127.8.51.126:41011)
0809 08:02:13.095187 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.095190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.096177 (+ 987us) server_negotiation.cc:407] Connection header received
0809 08:02:13.097519 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.097521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.097570 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.097712 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:13.098588 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.099105 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.100231 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.100566 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.100693 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.101849 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:13.101853 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:13.101856 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:13.101868 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:13.101893 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:13.101902 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:13.101979 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.102157 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.102216 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 08:02:13.102859 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.51.67:0
--local_ip_for_outbound_sockets=127.8.51.67
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--builtin_ntp_servers=127.8.51.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 08:02:13.103277 29866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.095412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:41011 (local address 127.8.51.66:53017)
0809 08:02:13.096026 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.096075 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.097316 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.097888 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.097894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.097978 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:13.098458 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.098471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.099208 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.099211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.100109 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.100118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.100715 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.100718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.100854 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.101528 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:13.101529 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:13.101569 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:13.101695 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:13.101998 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:13.102008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:13.102013 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.102154 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.102425 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":109,"threads_started":1}
I20260809 08:02:13.104378 29864 heartbeater.cc:347] Connected to a master server at 127.8.51.126:41011
I20260809 08:02:13.104627 29864 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:13.105129 29864 heartbeater.cc:511] Master 127.8.51.126:41011 requested a full tablet report, sending...
I20260809 08:02:13.106210 29517 ts_manager.cc:194] Registered new tserver with Master: b17d36cb366a4607883ace015cdedb6e (127.8.51.66:38787)
I20260809 08:02:13.107024 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.66:53017
W20260809 08:02:13.215622 29867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:13.215873 29867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:13.215909 29867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:13.219738 29867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:13.219805 29867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:13.219853 29867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.51.67
I20260809 08:02:13.224442 29867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.51.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.51.67
--webserver_port=0
--tserver_master_addrs=127.8.51.126:41011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.51.67
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:13.225337 29867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:13.226624 29867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:13.236054 29876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:13.236254 29867 server_base.cc:1034] running on GCE node
W20260809 08:02:13.236054 29873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:13.236166 29874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:13.236886 29867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:13.237468 29867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:13.238626 29867 hybrid_clock.cc:648] HybridClock initialized: now 1786262533238611 us; error 25 us; skew 500 ppm
I20260809 08:02:13.244664 29867 webserver.cc:460] Webserver started at http://127.8.51.67:42053/ using document root <none> and password file <none>
I20260809 08:02:13.245229 29867 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:13.245288 29867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:13.245520 29867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:13.247463 29867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data/instance:
uuid: "cb0f118f89bd4e959900707796e928c8"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "1e37b9abc384d46f4bb865d0222d9ded"
server_key_iv: "11f05e7304fb360feefb065f565c6faa"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.248001 29867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance:
uuid: "cb0f118f89bd4e959900707796e928c8"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "1e37b9abc384d46f4bb865d0222d9ded"
server_key_iv: "11f05e7304fb360feefb065f565c6faa"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.251546 29867 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 08:02:13.253907 29883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.255065 29867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:13.255199 29867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal
uuid: "cb0f118f89bd4e959900707796e928c8"
format_stamp: "Formatted at 2026-08-09 08:02:13 on dist-test-slave-njxd"
server_key: "1e37b9abc384d46f4bb865d0222d9ded"
server_key_iv: "11f05e7304fb360feefb065f565c6faa"
server_key_version: "encryptionkey@0"
I20260809 08:02:13.255299 29867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:13.283739 29867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:13.284474 29867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:13.284673 29867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:13.285270 29867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 08:02:13.286139 29867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 08:02:13.286188 29867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.286252 29867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 08:02:13.286293 29867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:13.295059 29867 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.67:45481
I20260809 08:02:13.295094 30002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.67:45481 every 8 connection(s)
I20260809 08:02:13.295956 29867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/data/info.pb
I20260809 08:02:13.300666 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 29867
I20260809 08:02:13.300799 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal/instance
I20260809 08:02:13.301060 8397 external_mini_cluster.cc:1428] Setting key 341d9381e9aefe4561924ffa0807b7c7
I20260809 08:02:13.304867 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.297718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.67:35721 (local address 127.8.51.126:41011)
0809 08:02:13.297845 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.297849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.298823 (+ 974us) server_negotiation.cc:407] Connection header received
0809 08:02:13.300205 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.300208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.300271 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.300377 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:13.301319 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.301957 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.303332 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.303542 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.303621 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.304496 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:13.304499 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:13.304501 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:13.304511 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:13.304530 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:13.304537 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:13.304594 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.304719 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.304766 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:13.305704 30005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.298056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:41011 (local address 127.8.51.67:35721)
0809 08:02:13.298675 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.298713 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.300001 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.300544 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.300556 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.300634 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:13.301178 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.301201 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.302093 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.302096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.303219 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.303232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.303661 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.303664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.303798 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.304283 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 08:02:13.304284 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:13.304318 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 08:02:13.304375 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:13.304608 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:13.304614 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:13.304618 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.304708 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.304900 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260809 08:02:13.306674 30003 heartbeater.cc:347] Connected to a master server at 127.8.51.126:41011
I20260809 08:02:13.306888 30003 heartbeater.cc:464] Registering TS with master...
I20260809 08:02:13.307346 30003 heartbeater.cc:511] Master 127.8.51.126:41011 requested a full tablet report, sending...
I20260809 08:02:13.308290 29517 ts_manager.cc:194] Registered new tserver with Master: cb0f118f89bd4e959900707796e928c8 (127.8.51.67:45481)
I20260809 08:02:13.308786 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.51.67:35721
I20260809 08:02:13.314841 8397 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 08:02:13.319965 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.316706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57804 (local address 127.8.51.126:41011)
0809 08:02:13.316817 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.316820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.316966 (+ 146us) server_negotiation.cc:407] Connection header received
0809 08:02:13.317051 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.317053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.317087 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.317150 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:13.317378 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.317887 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.318667 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.318868 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.318940 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.319621 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:13.319624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:13.319627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:13.319637 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:13.319654 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:13.319661 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:13.319725 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.319829 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.319875 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 08:02:13.322436 29517 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 08:02:13.325281 29517 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 08:02:13.338378 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.332953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:45481 (local address 127.0.0.1:60556)
0809 08:02:13.333259 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.333304 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.333427 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.334122 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.334127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.334148 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:13.334268 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.334275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.335625 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.335628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.336786 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.336795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.337848 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.337851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.337963 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338007 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.338120 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.338244 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260809 08:02:13.338402 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.333058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60556 (local address 127.8.51.67:45481)
0809 08:02:13.333639 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.333649 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.333677 (+ 28us) server_negotiation.cc:407] Connection header received
0809 08:02:13.333757 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.333762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.333956 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.334122 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:13.334399 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.335509 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.336922 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.337731 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.337836 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338012 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.338157 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.338244 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":87,"threads_started":1}
I20260809 08:02:13.338860 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.333603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34197 (local address 127.0.0.1:60486)
0809 08:02:13.334031 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.334044 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.334136 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.335052 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.335055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.335072 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:13.335152 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.335157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.336222 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.336225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.337221 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.337230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.338456 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.338461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.338566 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338587 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.338668 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.338726 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":3,"thread_start_us":111,"threads_started":1}
I20260809 08:02:13.339048 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.333318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38787 (local address 127.0.0.1:37164)
0809 08:02:13.333848 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.333860 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.333939 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.335134 (+ 1195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.335137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.335155 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:13.335252 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.335262 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.336566 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.336569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.337638 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.337648 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.338658 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.338661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.338751 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338772 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.338855 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.338925 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":88,"threads_started":1}
I20260809 08:02:13.339121 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.333614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.8.51.66:38787)
0809 08:02:13.334680 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.334692 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.334715 (+ 23us) server_negotiation.cc:407] Connection header received
0809 08:02:13.334795 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.334800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.334989 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.335155 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:13.335373 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.336457 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.337767 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.338505 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.338629 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338786 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.338881 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.338961 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947,"thread_start_us":102,"threads_started":1}
I20260809 08:02:13.339497 30020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.334027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60486 (local address 127.8.51.65:34197)
0809 08:02:13.334451 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.334462 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.334483 (+ 21us) server_negotiation.cc:407] Connection header received
0809 08:02:13.334567 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.334572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.334782 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.334920 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:13.335273 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.336112 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.337353 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.338138 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.338236 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.338389 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.339265 (+ 876us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.339350 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":94,"threads_started":1}
I20260809 08:02:13.341317 29933 tablet_service.cc:1467] Processing CreateTablet for tablet 95dbc016def14265b748d8005339034e (DEFAULT_TABLE table=test-table [id=46c826277e304af68473cdb20f3703cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:13.341841 29651 tablet_service.cc:1467] Processing CreateTablet for tablet 95dbc016def14265b748d8005339034e (DEFAULT_TABLE table=test-table [id=46c826277e304af68473cdb20f3703cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:13.341845 29795 tablet_service.cc:1467] Processing CreateTablet for tablet 95dbc016def14265b748d8005339034e (DEFAULT_TABLE table=test-table [id=46c826277e304af68473cdb20f3703cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 08:02:13.342252 29933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95dbc016def14265b748d8005339034e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:13.342836 29651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95dbc016def14265b748d8005339034e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:13.342836 29795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95dbc016def14265b748d8005339034e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:13.348006 30021 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Bootstrap starting.
I20260809 08:02:13.349346 30022 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Bootstrap starting.
I20260809 08:02:13.350452 30023 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Bootstrap starting.
I20260809 08:02:13.350540 30021 tablet_bootstrap.cc:654] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:13.351423 30021 log.cc:824] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:13.351475 30022 tablet_bootstrap.cc:654] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:13.352223 30023 tablet_bootstrap.cc:654] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:13.352272 30022 log.cc:824] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:13.353086 30023 log.cc:824] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:13.353529 30021 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: No bootstrap required, opened a new log
I20260809 08:02:13.353751 30021 ts_tablet_manager.cc:1397] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260809 08:02:13.354202 30022 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: No bootstrap required, opened a new log
I20260809 08:02:13.354387 30022 ts_tablet_manager.cc:1397] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:13.354914 30023 tablet_bootstrap.cc:492] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: No bootstrap required, opened a new log
I20260809 08:02:13.355118 30023 ts_tablet_manager.cc:1397] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:13.357913 30023 raft_consensus.cc:348] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.358121 30023 raft_consensus.cc:374] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:13.357980 30021 raft_consensus.cc:348] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.358188 30023 raft_consensus.cc:729] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17138e59006c4b7e8778121b0cc91e75, State: Initialized, Role: FOLLOWER
I20260809 08:02:13.358260 30021 raft_consensus.cc:374] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:13.358323 30021 raft_consensus.cc:729] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0f118f89bd4e959900707796e928c8, State: Initialized, Role: FOLLOWER
I20260809 08:02:13.358178 30022 raft_consensus.cc:348] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.358454 30022 raft_consensus.cc:374] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:13.358628 30022 raft_consensus.cc:729] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17d36cb366a4607883ace015cdedb6e, State: Initialized, Role: FOLLOWER
I20260809 08:02:13.358700 30023 consensus_queue.cc:260] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.358772 30021 consensus_queue.cc:260] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.359014 30022 consensus_queue.cc:260] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.359422 30003 heartbeater.cc:503] Master 127.8.51.126:41011 was elected leader, sending a full tablet report...
I20260809 08:02:13.359771 30023 ts_tablet_manager.cc:1428] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 08:02:13.359772 30021 ts_tablet_manager.cc:1428] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260809 08:02:13.360140 29725 heartbeater.cc:503] Master 127.8.51.126:41011 was elected leader, sending a full tablet report...
I20260809 08:02:13.360172 30022 ts_tablet_manager.cc:1428] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 08:02:13.360495 29864 heartbeater.cc:503] Master 127.8.51.126:41011 was elected leader, sending a full tablet report...
W20260809 08:02:13.399518 29726 tablet.cc:2369] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:13.409132 30028 raft_consensus.cc:482] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 08:02:13.409317 30028 raft_consensus.cc:504] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.410638 30028 leader_election.cc:288] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb0f118f89bd4e959900707796e928c8 (127.8.51.67:45481), b17d36cb366a4607883ace015cdedb6e (127.8.51.66:38787)
I20260809 08:02:13.415845 30031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.410941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.66:38787 (local address 127.8.51.65:39429)
0809 08:02:13.411400 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.411413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.411483 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.411734 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.411737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.411750 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:13.411854 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.411861 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.412815 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.412818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.414325 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.414336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.415312 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.415316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.415448 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.415484 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.415564 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.415639 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":120,"thread_start_us":103,"threads_started":1}
I20260809 08:02:13.415850 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.411036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:39429 (local address 127.8.51.66:38787)
0809 08:02:13.411193 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.411198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.411492 (+ 294us) server_negotiation.cc:407] Connection header received
0809 08:02:13.411553 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.411557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.411633 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.411707 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:13.411972 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.412711 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.414494 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.415161 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.415286 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.415356 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.415616 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.415700 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 08:02:13.415850 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.410951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.51.65:55597 (local address 127.8.51.67:45481)
0809 08:02:13.411239 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.411244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.411263 (+ 19us) server_negotiation.cc:407] Connection header received
0809 08:02:13.411418 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.411421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.411481 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.411589 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 08:02:13.411893 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.412698 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.414681 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.415306 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.415410 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.415472 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.415625 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.415700 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260809 08:02:13.415851 30030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.410827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.67:45481 (local address 127.8.51.65:55597)
0809 08:02:13.411166 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.411193 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:13.411297 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:13.411592 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:13.411618 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:13.411630 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 08:02:13.411777 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.411783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.412815 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.412818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.414325 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:13.414336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.415398 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.415401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:13.415496 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.415521 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 08:02:13.415590 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 08:02:13.415639 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":181,"thread_start_us":131,"threads_started":1}
I20260809 08:02:13.416726 29954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95dbc016def14265b748d8005339034e" candidate_uuid: "17138e59006c4b7e8778121b0cc91e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0f118f89bd4e959900707796e928c8" is_pre_election: true
I20260809 08:02:13.417023 29954 raft_consensus.cc:2454] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17138e59006c4b7e8778121b0cc91e75 in term 0.
I20260809 08:02:13.417476 29601 leader_election.cc:302] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17138e59006c4b7e8778121b0cc91e75, cb0f118f89bd4e959900707796e928c8; no voters:
I20260809 08:02:13.417527 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95dbc016def14265b748d8005339034e" candidate_uuid: "17138e59006c4b7e8778121b0cc91e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17d36cb366a4607883ace015cdedb6e" is_pre_election: true
I20260809 08:02:13.417795 30028 raft_consensus.cc:2781] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 08:02:13.417881 30028 raft_consensus.cc:482] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 08:02:13.417912 30028 raft_consensus.cc:3037] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:13.417868 29816 raft_consensus.cc:2454] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17138e59006c4b7e8778121b0cc91e75 in term 0.
I20260809 08:02:13.418991 30028 raft_consensus.cc:504] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.419334 30028 leader_election.cc:288] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [CANDIDATE]: Term 1 election: Requested vote from peers cb0f118f89bd4e959900707796e928c8 (127.8.51.67:45481), b17d36cb366a4607883ace015cdedb6e (127.8.51.66:38787)
I20260809 08:02:13.419629 29954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95dbc016def14265b748d8005339034e" candidate_uuid: "17138e59006c4b7e8778121b0cc91e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0f118f89bd4e959900707796e928c8"
I20260809 08:02:13.419714 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95dbc016def14265b748d8005339034e" candidate_uuid: "17138e59006c4b7e8778121b0cc91e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b17d36cb366a4607883ace015cdedb6e"
I20260809 08:02:13.419775 29954 raft_consensus.cc:3037] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:13.419858 29816 raft_consensus.cc:3037] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:13.420806 29954 raft_consensus.cc:2454] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17138e59006c4b7e8778121b0cc91e75 in term 1.
I20260809 08:02:13.420996 29816 raft_consensus.cc:2454] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17138e59006c4b7e8778121b0cc91e75 in term 1.
I20260809 08:02:13.421137 29601 leader_election.cc:302] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17138e59006c4b7e8778121b0cc91e75, cb0f118f89bd4e959900707796e928c8; no voters:
I20260809 08:02:13.421325 30028 raft_consensus.cc:2781] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:13.421625 30028 raft_consensus.cc:686] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [term 1 LEADER]: Becoming Leader. State: Replica: 17138e59006c4b7e8778121b0cc91e75, State: Running, Role: LEADER
I20260809 08:02:13.421983 30028 consensus_queue.cc:237] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } }
I20260809 08:02:13.425073 29517 catalog_manager.cc:5495] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17138e59006c4b7e8778121b0cc91e75 (127.8.51.65). New cstate: current_term: 1 leader_uuid: "17138e59006c4b7e8778121b0cc91e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17138e59006c4b7e8778121b0cc91e75" member_type: VOTER last_known_addr { host: "127.8.51.65" port: 34197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260809 08:02:13.441807 30020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.438625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60502 (local address 127.8.51.65:34197)
0809 08:02:13.438755 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:13.438759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:13.438772 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:13.438901 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:13.438903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:13.438956 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:13.439042 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:13.439300 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.439781 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.440577 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:13.440769 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:13.440839 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:13.441081 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:13.441467 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:13.441555 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:13.441662 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 08:02:13.441705 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 08:02:13.447490 29954 raft_consensus.cc:1261] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 1 FOLLOWER]: Refusing update from remote peer 17138e59006c4b7e8778121b0cc91e75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:13.447490 29816 raft_consensus.cc:1261] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 1 FOLLOWER]: Refusing update from remote peer 17138e59006c4b7e8778121b0cc91e75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:13.448269 30028 consensus_queue.cc:1035] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0f118f89bd4e959900707796e928c8" member_type: VOTER last_known_addr { host: "127.8.51.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:13.448479 30032 consensus_queue.cc:1035] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b17d36cb366a4607883ace015cdedb6e" member_type: VOTER last_known_addr { host: "127.8.51.66" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:13.457393 30037 mvcc.cc:205] Tried to move back new op lower bound from 7316531336993460224 to 7316531336899170304. Current Snapshot: MvccSnapshot[applied={T|T < 7316531336993460224}]
I20260809 08:02:13.457660 30036 mvcc.cc:205] Tried to move back new op lower bound from 7316531336993460224 to 7316531336899170304. Current Snapshot: MvccSnapshot[applied={T|T < 7316531336993460224}]
I20260809 08:02:13.463721 29515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:13.463886 29515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 08:02:13.466377 29515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03f42e7b4e61486b986c11b70bca04ee: Sending DeleteTablet for 3 replicas of tablet 95dbc016def14265b748d8005339034e
I20260809 08:02:13.467244 29933 tablet_service.cc:1514] Processing DeleteTablet for tablet 95dbc016def14265b748d8005339034e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:13 UTC) from {username='slave'} at 127.0.0.1:60556
I20260809 08:02:13.467244 29651 tablet_service.cc:1514] Processing DeleteTablet for tablet 95dbc016def14265b748d8005339034e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:13 UTC) from {username='slave'} at 127.0.0.1:60486
I20260809 08:02:13.467243 29795 tablet_service.cc:1514] Processing DeleteTablet for tablet 95dbc016def14265b748d8005339034e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 08:02:13 UTC) from {username='slave'} at 127.0.0.1:37164
I20260809 08:02:13.467730 30046 tablet_replica.cc:330] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: stopping tablet replica
I20260809 08:02:13.467882 30044 tablet_replica.cc:330] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: stopping tablet replica
I20260809 08:02:13.467978 30045 tablet_replica.cc:330] T 95dbc016def14265b748d8005339034e P 17138e59006c4b7e8778121b0cc91e75: stopping tablet replica
I20260809 08:02:13.468017 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29580
I20260809 08:02:13.469306 30046 raft_consensus.cc:2229] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:13.469715 30046 raft_consensus.cc:2258] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:13.472692 30046 ts_tablet_manager.cc:1905] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:13.473874 30044 raft_consensus.cc:2229] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 08:02:13.474189 30044 raft_consensus.cc:2258] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 08:02:13.475452 30044 ts_tablet_manager.cc:1905] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 08:02:13.475554 30046 ts_tablet_manager.cc:1918] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:13.475700 30046 log.cc:1196] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-1/wal/wals/95dbc016def14265b748d8005339034e
I20260809 08:02:13.476047 30046 ts_tablet_manager.cc:1939] T 95dbc016def14265b748d8005339034e P b17d36cb366a4607883ace015cdedb6e: Deleting consensus metadata
I20260809 08:02:13.477346 29502 catalog_manager.cc:4841] TS b17d36cb366a4607883ace015cdedb6e (127.8.51.66:38787): tablet 95dbc016def14265b748d8005339034e (table test-table [id=46c826277e304af68473cdb20f3703cb]) successfully deleted
I20260809 08:02:13.477905 30044 ts_tablet_manager.cc:1918] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 08:02:13.478068 30044 log.cc:1196] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Deleting WAL directory at /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786262281998942-8397-0/minicluster-data/ts-2/wal/wals/95dbc016def14265b748d8005339034e
W20260809 08:02:13.478119 29504 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.51.65:34197 (error 108)
I20260809 08:02:13.478354 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29728
I20260809 08:02:13.478428 30044 ts_tablet_manager.cc:1939] T 95dbc016def14265b748d8005339034e P cb0f118f89bd4e959900707796e928c8: Deleting consensus metadata
I20260809 08:02:13.479598 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:13.479321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.65:34197 (local address 127.0.0.1:60512)
0809 08:02:13.479442 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:13.479519 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 08:02:13.479795 29504 catalog_manager.cc:4584] TS 17138e59006c4b7e8778121b0cc91e75 (127.8.51.65:34197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 95dbc016def14265b748d8005339034e: Network error: Client connection negotiation failed: client connection to 127.8.51.65:34197: connect: Connection refused (error 111)
I20260809 08:02:13.480439 29504 catalog_manager.cc:4841] TS cb0f118f89bd4e959900707796e928c8 (127.8.51.67:45481): tablet 95dbc016def14265b748d8005339034e (table test-table [id=46c826277e304af68473cdb20f3703cb]) successfully deleted
I20260809 08:02:13.485306 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29867
I20260809 08:02:13.492051 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 29484
2026-08-09T08:02:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1060 ms)
[----------] 6 tests from EncryptionPolicyTest (10552 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:13 dist-test-slave-njxd krb5kdc[30051](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:13 dist-test-slave-njxd krb5kdc[30051](info): set up 2 sockets
Aug 09 08:02:13 dist-test-slave-njxd krb5kdc[30051](info): commencing operation
krb5kdc: starting...
W20260809 08:02:14.538312 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:14.660528 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:14.765370 30065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:14.765738 30065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:14.765818 30065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:14.769920 30065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:14.770018 30065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:14.770061 30065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:14.770151 30065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:14.770187 30065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:14.775655 30065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46247
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:14.776775 30065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:14.777899 30065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:14.786298 30073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:14.786474 30065 server_base.cc:1034] running on GCE node
W20260809 08:02:14.786324 30071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:14.786644 30070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:14.787235 30065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:14.788341 30065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:14.789520 30065 hybrid_clock.cc:648] HybridClock initialized: now 1786262534789493 us; error 51 us; skew 500 ppm
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262534, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:14.793040 30065 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:14.794056 30065 webserver.cc:460] Webserver started at http://127.0.0.1:41333/ using document root <none> and password file <none>
I20260809 08:02:14.794646 30065 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:14.794749 30065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:14.794978 30065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:14.797075 30065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f"
format_stamp: "Formatted at 2026-08-09 08:02:14 on dist-test-slave-njxd"
server_key: "6a9385cf2c822ee750246bc1bb7f92dd"
server_key_iv: "370040e4c039c3e762555cca3e8dfcad"
server_key_version: "encryptionkey@0"
I20260809 08:02:14.797737 30065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f"
format_stamp: "Formatted at 2026-08-09 08:02:14 on dist-test-slave-njxd"
server_key: "6a9385cf2c822ee750246bc1bb7f92dd"
server_key_iv: "370040e4c039c3e762555cca3e8dfcad"
server_key_version: "encryptionkey@0"
I20260809 08:02:14.801373 30065 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:14.803808 30080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:14.804955 30065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:14.805106 30065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f"
format_stamp: "Formatted at 2026-08-09 08:02:14 on dist-test-slave-njxd"
server_key: "6a9385cf2c822ee750246bc1bb7f92dd"
server_key_iv: "370040e4c039c3e762555cca3e8dfcad"
server_key_version: "encryptionkey@0"
I20260809 08:02:14.805218 30065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:14.823671 30065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:14.827188 30065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:14.827409 30065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:14.834604 30065 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46247
I20260809 08:02:14.834621 30136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46247 every 8 connection(s)
I20260809 08:02:14.835569 30065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:14.836745 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30065
I20260809 08:02:14.836882 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:14.837210 8397 external_mini_cluster.cc:1428] Setting key 40b9afe506a804cd7a0e41eb9155b8f7
I20260809 08:02:14.839030 30137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:14.844508 30137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f: Bootstrap starting.
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 08:02:14.847149 30137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:14.847888 30137 log.cc:824] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:14.850353 30137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f: No bootstrap required, opened a new log
I20260809 08:02:14.852378 30141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:14.838700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45311 (local address 127.0.0.1:46247)
0809 08:02:14.839193 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:14.839210 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:14.839246 (+ 36us) server_negotiation.cc:407] Connection header received
0809 08:02:14.839870 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:14.839886 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:14.840222 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:14.840587 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:14.841419 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:14.842516 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:14.843396 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:14.843862 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:14.844030 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:14.847002 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:14.847007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:14.847021 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:14.847048 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:14.849092 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:14.849664 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:14.849671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:14.849676 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:14.849820 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:14.850163 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:14.850166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:14.850168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:14.850677 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:14.850897 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:14.851181 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 08:02:14.851416 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":136,"threads_started":1}
I20260809 08:02:14.854854 30137 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260809 08:02:14.855141 30137 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:14.855212 30137 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1fac4ea56c34c8c88f06fd9d6ff0e5f, State: Initialized, Role: FOLLOWER
I20260809 08:02:14.855690 30137 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260809 08:02:14.855863 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:14.855890 30137 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:14.855993 30137 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:14.856110 30137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:14.857124 30137 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260809 08:02:14.857496 30137 leader_election.cc:302] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1fac4ea56c34c8c88f06fd9d6ff0e5f; no voters:
I20260809 08:02:14.857892 30137 leader_election.cc:288] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:14.857990 30147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:14.858295 30147 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [term 1 LEADER]: Becoming Leader. State: Replica: b1fac4ea56c34c8c88f06fd9d6ff0e5f, State: Running, Role: LEADER
I20260809 08:02:14.858608 30147 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260809 08:02:14.859241 30137 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:14.859761 30147 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1fac4ea56c34c8c88f06fd9d6ff0e5f. Latest consensus state: current_term: 1 leader_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } } }
I20260809 08:02:14.859966 30147 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:14.860229 30151 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fac4ea56c34c8c88f06fd9d6ff0e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } } }
I20260809 08:02:14.860409 30151 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:14.860414 30155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:14.864027 30155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:14.869752 30141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:14.858090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55125 (local address 127.0.0.1:46247)
0809 08:02:14.858208 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:14.858214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:14.860691 (+ 2477us) server_negotiation.cc:407] Connection header received
0809 08:02:14.860805 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:14.860808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:14.860866 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:14.860957 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:14.862189 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:14.862986 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:14.863806 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:14.864155 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:14.864266 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:14.866029 (+ 1763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:14.866033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:14.866036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:14.866067 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:14.867660 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:14.868184 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:14.868187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:14.868189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:14.868288 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:14.868641 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:14.868644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:14.868646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:14.868876 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:14.869020 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:14.869336 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 08:02:14.869605 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:14.869776 30155 catalog_manager.cc:1347] Generated new cluster ID: db8ade3bf9bd4e47a73db2dfd66b0dc7
I20260809 08:02:14.870123 30155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:14.898690 30155 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:14.899883 30155 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:14.905380 30155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1fac4ea56c34c8c88f06fd9d6ff0e5f: Generated new TSK 0
I20260809 08:02:14.906103 30155 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:14.912319 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30065
W20260809 08:02:14.919660 30048 connection.cc:535] client connection to 127.0.0.1:46247 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46247): Connection reset by peer (error 104)
2026-08-09T08:02:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30170](info): set up 2 sockets
Aug 09 08:02:14 dist-test-slave-njxd krb5kdc[30170](info): commencing operation
krb5kdc: starting...
W20260809 08:02:15.982968 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:16 dist-test-slave-njxd krb5kdc[30170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:16.106806 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:16.216998 30184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:16.217264 30184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:16.217305 30184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:16.221093 30184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:16.221148 30184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:16.221167 30184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:16.221182 30184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:16.221196 30184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:16.226281 30184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41353
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:16.227270 30184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:16.228248 30184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:16.236634 30190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:16.236678 30192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:16.236667 30189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:16.236819 30184 server_base.cc:1034] running on GCE node
I20260809 08:02:16.237425 30184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:16.238543 30184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:16.239737 30184 hybrid_clock.cc:648] HybridClock initialized: now 1786262536239723 us; error 25 us; skew 500 ppm
Aug 09 08:02:16 dist-test-slave-njxd krb5kdc[30170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262536, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:16.242574 30184 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:16.243484 30184 webserver.cc:460] Webserver started at http://127.0.0.1:44095/ using document root <none> and password file <none>
I20260809 08:02:16.244009 30184 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:16.244064 30184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:16.244228 30184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:16.246332 30184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "5b849064f90d470282677b829abbe138"
format_stamp: "Formatted at 2026-08-09 08:02:16 on dist-test-slave-njxd"
server_key: "40bd163a096217ced024ef1b72dcdb41"
server_key_iv: "e65158e7f73906e508824b30052c67f4"
server_key_version: "encryptionkey@0"
I20260809 08:02:16.246848 30184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "5b849064f90d470282677b829abbe138"
format_stamp: "Formatted at 2026-08-09 08:02:16 on dist-test-slave-njxd"
server_key: "40bd163a096217ced024ef1b72dcdb41"
server_key_iv: "e65158e7f73906e508824b30052c67f4"
server_key_version: "encryptionkey@0"
I20260809 08:02:16.250453 30184 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:02:16.252801 30201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:16.254110 30184 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:16.254222 30184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "5b849064f90d470282677b829abbe138"
format_stamp: "Formatted at 2026-08-09 08:02:16 on dist-test-slave-njxd"
server_key: "40bd163a096217ced024ef1b72dcdb41"
server_key_iv: "e65158e7f73906e508824b30052c67f4"
server_key_version: "encryptionkey@0"
I20260809 08:02:16.254310 30184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:16.278218 30184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:16.281122 30184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:16.281276 30184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:16.288484 30184 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41353
I20260809 08:02:16.288504 30256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41353 every 8 connection(s)
I20260809 08:02:16.289455 30184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:16.292333 30257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:16.293808 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30184
I20260809 08:02:16.293936 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:16.294212 8397 external_mini_cluster.cc:1428] Setting key 6a973c1023483de4fa0ec53158f6f16b
I20260809 08:02:16.298913 30257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: Bootstrap starting.
I20260809 08:02:16.301457 30257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:16.302384 30257 log.cc:824] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:16.304064 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:16.295619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43025 (local address 127.0.0.1:41353)
0809 08:02:16.296018 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:16.296037 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:16.296081 (+ 44us) server_negotiation.cc:407] Connection header received
0809 08:02:16.296916 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:16.296939 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:16.297371 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:16.297777 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:16.298170 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:16.299585 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:16.300440 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:16.301108 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:16.301255 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:16.302143 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:16.302148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:16.302166 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:16.302653 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:16.302720 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:16.302753 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:16.302912 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:16.303107 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 08:02:16.303394 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":95,"threads_started":1}
I20260809 08:02:16.304291 30257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: No bootstrap required, opened a new log
I20260809 08:02:16.306929 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:16.308141 30257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } }
I20260809 08:02:16.308355 30257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:16.308415 30257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b849064f90d470282677b829abbe138, State: Initialized, Role: FOLLOWER
I20260809 08:02:16.308876 30257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } }
I20260809 08:02:16.309054 30257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:16.309151 30257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:16.309250 30257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:16.310163 30257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } }
I20260809 08:02:16.310513 30257 leader_election.cc:302] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b849064f90d470282677b829abbe138; no voters:
I20260809 08:02:16.310801 30257 leader_election.cc:288] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:16.310906 30267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:16.311105 30267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [term 1 LEADER]: Becoming Leader. State: Replica: 5b849064f90d470282677b829abbe138, State: Running, Role: LEADER
I20260809 08:02:16.311474 30267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } }
I20260809 08:02:16.312112 30257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:16.313521 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:16.308808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38629 (local address 127.0.0.1:41353)
0809 08:02:16.308918 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:16.308922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:16.309188 (+ 266us) server_negotiation.cc:407] Connection header received
0809 08:02:16.309304 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:16.309308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:16.309351 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:16.309425 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:16.309729 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:16.310244 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:16.311406 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:16.311735 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:16.311839 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:16.312798 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:16.312802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:16.312804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:16.312817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:16.312842 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:16.312854 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:16.312931 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:16.313334 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 08:02:16.313370 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 08:02:16.313478 30269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b849064f90d470282677b829abbe138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } } }
I20260809 08:02:16.313720 30268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b849064f90d470282677b829abbe138. Latest consensus state: current_term: 1 leader_uuid: "5b849064f90d470282677b829abbe138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b849064f90d470282677b829abbe138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41353 } } }
I20260809 08:02:16.313812 30268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:16.314019 30269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138 [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:16.317353 30282 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:16.317425 30282 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:16.317476 30279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:16.318244 30279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:16.323383 30279 catalog_manager.cc:1347] Generated new cluster ID: 0a52c48d6bb84a11937c0bed437ed6eb
I20260809 08:02:16.323447 30279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:16.347790 30279 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:16.348658 30279 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:16.354013 30279 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b849064f90d470282677b829abbe138: Generated new TSK 0
I20260809 08:02:16.354676 30279 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:16.363708 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30184
W20260809 08:02:16.371173 30168 connection.cc:535] client connection to 127.0.0.1:41353 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41353): Connection reset by peer (error 104)
2026-08-09T08:02:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:16 dist-test-slave-njxd krb5kdc[30288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:16 dist-test-slave-njxd krb5kdc[30288](info): set up 2 sockets
Aug 09 08:02:16 dist-test-slave-njxd krb5kdc[30288](info): commencing operation
krb5kdc: starting...
W20260809 08:02:17.407191 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:17 dist-test-slave-njxd krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:17.532589 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:17.645084 30302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:17.645404 30302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:17.645481 30302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:17.649506 30302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:17.649627 30302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:17.649688 30302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:17.649744 30302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:17.649785 30302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:17.655103 30302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42483
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:17.656246 30302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:17.657305 30302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:17.665923 30310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:17.666075 30302 server_base.cc:1034] running on GCE node
W20260809 08:02:17.665942 30309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:17.665946 30312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:17.666783 30302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:17.667922 30302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:17.669121 30302 hybrid_clock.cc:648] HybridClock initialized: now 1786262537669103 us; error 40 us; skew 500 ppm
Aug 09 08:02:17 dist-test-slave-njxd krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:17.671954 30302 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:17.672925 30302 webserver.cc:460] Webserver started at http://127.0.0.1:33005/ using document root <none> and password file <none>
I20260809 08:02:17.673512 30302 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:17.673645 30302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:17.673939 30302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:17.676045 30302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "666efaa3e56e489691bc02a398509954"
format_stamp: "Formatted at 2026-08-09 08:02:17 on dist-test-slave-njxd"
server_key: "c6174c0e8a85337e0ccc7fb5d60b0e08"
server_key_iv: "57a19f435a4f4eb8640fd183aa224278"
server_key_version: "encryptionkey@0"
I20260809 08:02:17.676621 30302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "666efaa3e56e489691bc02a398509954"
format_stamp: "Formatted at 2026-08-09 08:02:17 on dist-test-slave-njxd"
server_key: "c6174c0e8a85337e0ccc7fb5d60b0e08"
server_key_iv: "57a19f435a4f4eb8640fd183aa224278"
server_key_version: "encryptionkey@0"
I20260809 08:02:17.680660 30302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 08:02:17.683195 30320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:17.684419 30302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:02:17.684561 30302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "666efaa3e56e489691bc02a398509954"
format_stamp: "Formatted at 2026-08-09 08:02:17 on dist-test-slave-njxd"
server_key: "c6174c0e8a85337e0ccc7fb5d60b0e08"
server_key_iv: "57a19f435a4f4eb8640fd183aa224278"
server_key_version: "encryptionkey@0"
I20260809 08:02:17.684703 30302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:17.689445 30302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:17.692222 30302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:17.692418 30302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:17.699615 30302 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42483
I20260809 08:02:17.699640 30374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42483 every 8 connection(s)
I20260809 08:02:17.700516 30302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:17.703032 30375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:17.708252 30375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: Bootstrap starting.
I20260809 08:02:17.709443 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30302
I20260809 08:02:17.709621 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:17.709904 8397 external_mini_cluster.cc:1428] Setting key ec3d6624a0af195426e6559ffc212422
I20260809 08:02:17.710755 30375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:17.711629 30375 log.cc:824] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:17.713498 30375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: No bootstrap required, opened a new log
I20260809 08:02:17.714803 30378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:17.711029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52095 (local address 127.0.0.1:42483)
0809 08:02:17.711468 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:17.711483 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:17.711516 (+ 33us) server_negotiation.cc:407] Connection header received
0809 08:02:17.712210 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:17.712229 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:17.712490 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:17.712829 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:17.713658 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:17.713663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:17.713674 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:17.713684 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:17.713735 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:17.713753 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:17.713867 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:17.713977 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 08:02:17.714135 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":130,"threads_started":1}
I20260809 08:02:17.717139 30375 raft_consensus.cc:348] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } }
I20260809 08:02:17.717392 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:17.717412 30375 raft_consensus.cc:374] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:17.717486 30375 raft_consensus.cc:729] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666efaa3e56e489691bc02a398509954, State: Initialized, Role: FOLLOWER
I20260809 08:02:17.717926 30375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } }
I20260809 08:02:17.718072 30375 raft_consensus.cc:388] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:17.718158 30375 raft_consensus.cc:482] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:17.718253 30375 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:17.719203 30375 raft_consensus.cc:504] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } }
I20260809 08:02:17.719581 30375 leader_election.cc:302] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 666efaa3e56e489691bc02a398509954; no voters:
I20260809 08:02:17.719916 30375 leader_election.cc:288] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:17.719998 30386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:17.720230 30386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [term 1 LEADER]: Becoming Leader. State: Replica: 666efaa3e56e489691bc02a398509954, State: Running, Role: LEADER
I20260809 08:02:17.720619 30386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } }
I20260809 08:02:17.721258 30375 sys_catalog.cc:564] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:17.721761 30378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:17.719741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39697 (local address 127.0.0.1:42483)
0809 08:02:17.719843 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:17.719846 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:17.720111 (+ 265us) server_negotiation.cc:407] Connection header received
0809 08:02:17.720334 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:17.720337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:17.720385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:17.720432 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:17.721287 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:17.721291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:17.721293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:17.721305 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:17.721331 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:17.721343 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:17.721397 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:17.721581 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 08:02:17.721644 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 08:02:17.722048 30386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666efaa3e56e489691bc02a398509954. Latest consensus state: current_term: 1 leader_uuid: "666efaa3e56e489691bc02a398509954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } } }
I20260809 08:02:17.722150 30386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:17.722762 30387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "666efaa3e56e489691bc02a398509954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666efaa3e56e489691bc02a398509954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42483 } } }
I20260809 08:02:17.722903 30387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954 [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:17.725962 30402 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:17.726025 30402 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:17.726102 30395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:17.726759 30395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:17.731791 30395 catalog_manager.cc:1347] Generated new cluster ID: 29eb03f920bc4a78bc76c30ef6919842
I20260809 08:02:17.731850 30395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:17.741915 30395 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:17.742236 30395 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:17.754142 30395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 666efaa3e56e489691bc02a398509954: Generated new TSK 0
I20260809 08:02:17.754920 30395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:17.763522 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30302
2026-08-09T08:02:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1399 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:17 dist-test-slave-njxd krb5kdc[30408](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:17 dist-test-slave-njxd krb5kdc[30408](info): set up 2 sockets
Aug 09 08:02:17 dist-test-slave-njxd krb5kdc[30408](info): commencing operation
krb5kdc: starting...
W20260809 08:02:18.802922 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:18 dist-test-slave-njxd krb5kdc[30408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:18.924191 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34919
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:19.034271 30422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:19.034495 30422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:19.034575 30422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:19.038442 30422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:19.038491 30422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:19.038508 30422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:19.038522 30422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:19.038568 30422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:19.043586 30422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:19.044546 30422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:19.045544 30422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:19.053953 30422 server_base.cc:1034] running on GCE node
W20260809 08:02:19.053900 30430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:19.053913 30427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:19.053903 30428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:19.054745 30422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:19.055794 30422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:19.056995 30422 hybrid_clock.cc:648] HybridClock initialized: now 1786262539056982 us; error 26 us; skew 500 ppm
Aug 09 08:02:19 dist-test-slave-njxd krb5kdc[30408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262539, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:19.063090 30422 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:19.063990 30422 webserver.cc:460] Webserver started at http://127.0.0.1:34605/ using document root <none> and password file <none>
I20260809 08:02:19.064558 30422 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:19.064663 30422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:19.064895 30422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:19.066948 30422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "88e72e73f42a4be18519780518414208"
format_stamp: "Formatted at 2026-08-09 08:02:19 on dist-test-slave-njxd"
server_key: "7e2fb16606011c017c98d42233e904b9"
server_key_iv: "c06bed37b5e81a86b579744b003bab78"
server_key_version: "encryptionkey@0"
I20260809 08:02:19.067514 30422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "88e72e73f42a4be18519780518414208"
format_stamp: "Formatted at 2026-08-09 08:02:19 on dist-test-slave-njxd"
server_key: "7e2fb16606011c017c98d42233e904b9"
server_key_iv: "c06bed37b5e81a86b579744b003bab78"
server_key_version: "encryptionkey@0"
I20260809 08:02:19.072125 30422 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 08:02:19.075886 30438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:19.077528 30422 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 08:02:19.077695 30422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "88e72e73f42a4be18519780518414208"
format_stamp: "Formatted at 2026-08-09 08:02:19 on dist-test-slave-njxd"
server_key: "7e2fb16606011c017c98d42233e904b9"
server_key_iv: "c06bed37b5e81a86b579744b003bab78"
server_key_version: "encryptionkey@0"
I20260809 08:02:19.077821 30422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:19.097397 30422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:19.100382 30422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:19.100602 30422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:19.107484 30422 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34919
I20260809 08:02:19.107546 30495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34919 every 8 connection(s)
I20260809 08:02:19.108502 30422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:19.110839 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30422
I20260809 08:02:19.110970 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:19.111291 8397 external_mini_cluster.cc:1428] Setting key 54059b4c2c2b362b56b2fe0819c32e93
I20260809 08:02:19.111676 30496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:19.117872 30496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: Bootstrap starting.
Aug 09 08:02:19 dist-test-slave-njxd krb5kdc[30408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 08:02:19.120278 30496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:19.121028 30496 log.cc:824] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:19.123096 30496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: No bootstrap required, opened a new log
I20260809 08:02:19.125331 30499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:19.112738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43945 (local address 127.0.0.1:34919)
0809 08:02:19.113168 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:19.113185 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:19.113220 (+ 35us) server_negotiation.cc:407] Connection header received
0809 08:02:19.113938 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:19.113957 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:19.114295 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:19.114690 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:19.115529 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:19.116518 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:19.117386 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:19.117949 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:19.118124 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:19.120777 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:19.120782 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:19.120812 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:19.120839 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:19.122616 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:19.123081 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:19.123086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:19.123090 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:19.123266 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:19.123538 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:19.123544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:19.123547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:19.123913 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:19.124118 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:19.124397 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 08:02:19.124675 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":136,"threads_started":1}
I20260809 08:02:19.126466 30496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } }
I20260809 08:02:19.126667 30496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:19.126730 30496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e72e73f42a4be18519780518414208, State: Initialized, Role: FOLLOWER
I20260809 08:02:19.127269 30496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } }
I20260809 08:02:19.127454 30496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:19.127524 30496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:19.127624 30496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:19.128274 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:19.128795 30496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } }
I20260809 08:02:19.129189 30496 leader_election.cc:302] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88e72e73f42a4be18519780518414208; no voters:
I20260809 08:02:19.129556 30496 leader_election.cc:288] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:19.129755 30501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:19.130026 30501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [term 1 LEADER]: Becoming Leader. State: Replica: 88e72e73f42a4be18519780518414208, State: Running, Role: LEADER
I20260809 08:02:19.130334 30501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } }
I20260809 08:02:19.130849 30496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:19.131469 30501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88e72e73f42a4be18519780518414208. Latest consensus state: current_term: 1 leader_uuid: "88e72e73f42a4be18519780518414208" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } } }
I20260809 08:02:19.131603 30501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:19.131973 30507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88e72e73f42a4be18519780518414208" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e72e73f42a4be18519780518414208" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34919 } } }
I20260809 08:02:19.132083 30507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208 [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:19.136155 30520 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:19.136250 30520 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:19.136356 30513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:19.137193 30513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:19.141883 30499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:19.133351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55229 (local address 127.0.0.1:34919)
0809 08:02:19.133443 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:19.133448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:19.133821 (+ 373us) server_negotiation.cc:407] Connection header received
0809 08:02:19.133897 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:19.133900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:19.133942 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:19.134055 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:19.134740 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:19.135508 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:19.136602 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:19.136893 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:19.136997 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:19.138495 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:19.138498 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:19.138501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:19.138531 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:19.140071 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:19.140558 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:19.140561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:19.140562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:19.140634 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:19.140917 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:19.140922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:19.140923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:19.141127 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:19.141258 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:19.141550 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 08:02:19.141695 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 08:02:19.146962 30513 catalog_manager.cc:1347] Generated new cluster ID: 766b5539497246bd9d9d9fcab92c739f
I20260809 08:02:19.147037 30513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:19.153800 30513 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:19.154671 30513 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:19.159058 30513 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88e72e73f42a4be18519780518414208: Generated new TSK 0
I20260809 08:02:19.159829 30513 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:19.169435 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30422
2026-08-09T08:02:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1407 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:19 dist-test-slave-njxd krb5kdc[30527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:19 dist-test-slave-njxd krb5kdc[30527](info): set up 2 sockets
Aug 09 08:02:19 dist-test-slave-njxd krb5kdc[30527](info): commencing operation
krb5kdc: starting...
W20260809 08:02:20.223713 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:20 dist-test-slave-njxd krb5kdc[30527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:20.350138 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:20.462316 30541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:20.462643 30541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:20.462733 30541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:20.467208 30541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:20.467298 30541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:20.467335 30541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:20.467382 30541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:20.467414 30541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:20.472651 30541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:20.473719 30541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:20.474787 30541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:20.483063 30541 server_base.cc:1034] running on GCE node
W20260809 08:02:20.483037 30547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:20.483026 30549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:20.483271 30546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:20.483844 30541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:20.484862 30541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:20.486065 30541 hybrid_clock.cc:648] HybridClock initialized: now 1786262540486053 us; error 25 us; skew 500 ppm
Aug 09 08:02:20 dist-test-slave-njxd krb5kdc[30527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262540, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:20.488765 30541 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:20.489710 30541 webserver.cc:460] Webserver started at http://127.0.0.1:46167/ using document root <none> and password file <none>
I20260809 08:02:20.490224 30541 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:20.490283 30541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:20.490446 30541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:20.492394 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "9eee06466f2e4be78328105f7ed8c8b1"
format_stamp: "Formatted at 2026-08-09 08:02:20 on dist-test-slave-njxd"
server_key: "071fd39e36d6afa77062c3c8392f441d"
server_key_iv: "e60be34e85a87634e892a212cec6532f"
server_key_version: "encryptionkey@0"
I20260809 08:02:20.492901 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "9eee06466f2e4be78328105f7ed8c8b1"
format_stamp: "Formatted at 2026-08-09 08:02:20 on dist-test-slave-njxd"
server_key: "071fd39e36d6afa77062c3c8392f441d"
server_key_iv: "e60be34e85a87634e892a212cec6532f"
server_key_version: "encryptionkey@0"
I20260809 08:02:20.496567 30541 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 08:02:20.499094 30556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:20.500663 30541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 08:02:20.500811 30541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "9eee06466f2e4be78328105f7ed8c8b1"
format_stamp: "Formatted at 2026-08-09 08:02:20 on dist-test-slave-njxd"
server_key: "071fd39e36d6afa77062c3c8392f441d"
server_key_iv: "e60be34e85a87634e892a212cec6532f"
server_key_version: "encryptionkey@0"
I20260809 08:02:20.500921 30541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:20.517846 30541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:20.520782 30541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:20.520961 30541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:20.528512 30541 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37847
I20260809 08:02:20.528541 30614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37847 every 8 connection(s)
I20260809 08:02:20.529523 30541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:20.532402 30615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:20.537245 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30541
I20260809 08:02:20.537410 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:20.537771 8397 external_mini_cluster.cc:1428] Setting key 2d35f9b41cfc858d5a48e9e213056e37
I20260809 08:02:20.538573 30615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1: Bootstrap starting.
I20260809 08:02:20.541054 30615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:20.541967 30615 log.cc:824] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:20.544070 30615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1: No bootstrap required, opened a new log
I20260809 08:02:20.547230 30619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:20.539245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49087 (local address 127.0.0.1:37847)
0809 08:02:20.539699 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:20.539716 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:20.539754 (+ 38us) server_negotiation.cc:407] Connection header received
0809 08:02:20.540385 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:20.540403 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:20.540756 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:20.541042 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:20.541476 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:20.542561 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:20.543497 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:20.544178 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:20.544342 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:20.545136 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:20.545142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:20.545159 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:20.545716 (+ 557us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:20.545779 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:20.545808 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:20.545903 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:20.546016 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 08:02:20.546231 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":159,"threads_started":1}
I20260809 08:02:20.548540 30615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } }
I20260809 08:02:20.548823 30615 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:20.548883 30615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eee06466f2e4be78328105f7ed8c8b1, State: Initialized, Role: FOLLOWER
I20260809 08:02:20.549373 30615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } }
I20260809 08:02:20.549538 30615 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:20.549639 30615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:20.549762 30615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:20.550369 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:20.551023 30615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } }
I20260809 08:02:20.551422 30615 leader_election.cc:302] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eee06466f2e4be78328105f7ed8c8b1; no voters:
I20260809 08:02:20.551783 30615 leader_election.cc:288] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:20.551921 30622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:20.552255 30622 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [term 1 LEADER]: Becoming Leader. State: Replica: 9eee06466f2e4be78328105f7ed8c8b1, State: Running, Role: LEADER
I20260809 08:02:20.553146 30622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } }
I20260809 08:02:20.553452 30615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:20.554934 30627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eee06466f2e4be78328105f7ed8c8b1. Latest consensus state: current_term: 1 leader_uuid: "9eee06466f2e4be78328105f7ed8c8b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } } }
I20260809 08:02:20.555124 30627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:20.555437 30626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eee06466f2e4be78328105f7ed8c8b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eee06466f2e4be78328105f7ed8c8b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37847 } } }
I20260809 08:02:20.555531 30626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:20.555837 30638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:20.557557 30619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:20.552775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39049 (local address 127.0.0.1:37847)
0809 08:02:20.552898 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:20.552903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:20.553070 (+ 167us) server_negotiation.cc:407] Connection header received
0809 08:02:20.553181 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:20.553184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:20.553230 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:20.553304 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:20.553634 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:20.554405 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:20.555837 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:20.556156 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:20.556274 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:20.557123 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:20.557126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:20.557129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:20.557141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:20.557175 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:20.557186 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:20.557265 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:20.557364 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 08:02:20.557426 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 08:02:20.559252 30638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:20.565316 30638 catalog_manager.cc:1347] Generated new cluster ID: c3d5aedd819d408da50d425714b31e33
I20260809 08:02:20.565392 30638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:20.579124 30638 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:20.580132 30638 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:20.589134 30638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eee06466f2e4be78328105f7ed8c8b1: Generated new TSK 0
I20260809 08:02:20.590107 30638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:20.595769 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30541
2026-08-09T08:02:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:20 dist-test-slave-njxd krb5kdc[30647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:20 dist-test-slave-njxd krb5kdc[30647](info): set up 2 sockets
Aug 09 08:02:20 dist-test-slave-njxd krb5kdc[30647](info): commencing operation
krb5kdc: starting...
W20260809 08:02:21.655042 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:21 dist-test-slave-njxd krb5kdc[30647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:21.779974 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39429
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:21.891064 30660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:21.891296 30660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:21.891333 30660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:21.895516 30660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:21.895570 30660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:21.895594 30660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:21.895649 30660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:21.895677 30660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:21.900766 30660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:21.901752 30660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:21.902734 30660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:21.910746 30669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:21.910846 30660 server_base.cc:1034] running on GCE node
W20260809 08:02:21.910751 30666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:21.911024 30667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:21.911578 30660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:21.912542 30660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:21.913730 30660 hybrid_clock.cc:648] HybridClock initialized: now 1786262541913718 us; error 26 us; skew 500 ppm
Aug 09 08:02:21 dist-test-slave-njxd krb5kdc[30647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262541, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:21.916575 30660 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:21.917372 30660 webserver.cc:460] Webserver started at http://127.0.0.1:33677/ using document root <none> and password file <none>
I20260809 08:02:21.917938 30660 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:21.917996 30660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:21.918152 30660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:21.920007 30660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "8a4107707fc349f194f42b27a7fb2e3e"
format_stamp: "Formatted at 2026-08-09 08:02:21 on dist-test-slave-njxd"
server_key: "1ce0d87868f0528dad6d2e3c98c70327"
server_key_iv: "a79af222849dcceec2f45ba16b979067"
server_key_version: "encryptionkey@0"
I20260809 08:02:21.920495 30660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "8a4107707fc349f194f42b27a7fb2e3e"
format_stamp: "Formatted at 2026-08-09 08:02:21 on dist-test-slave-njxd"
server_key: "1ce0d87868f0528dad6d2e3c98c70327"
server_key_iv: "a79af222849dcceec2f45ba16b979067"
server_key_version: "encryptionkey@0"
I20260809 08:02:21.924083 30660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 08:02:21.926561 30678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:21.927752 30660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:21.927848 30660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "8a4107707fc349f194f42b27a7fb2e3e"
format_stamp: "Formatted at 2026-08-09 08:02:21 on dist-test-slave-njxd"
server_key: "1ce0d87868f0528dad6d2e3c98c70327"
server_key_iv: "a79af222849dcceec2f45ba16b979067"
server_key_version: "encryptionkey@0"
I20260809 08:02:21.927932 30660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:21.932324 30660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:21.935536 30660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:21.935812 30660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:21.942636 30660 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39429
I20260809 08:02:21.942727 30732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39429 every 8 connection(s)
I20260809 08:02:21.943562 30660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:21.946321 30733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:21.946394 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30660
I20260809 08:02:21.946514 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:21.946820 8397 external_mini_cluster.cc:1428] Setting key 36caf25242da78a787470416b2ed290d
I20260809 08:02:21.952040 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:21.948118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43307 (local address 127.0.0.1:39429)
0809 08:02:21.948503 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:21.948517 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:21.948551 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:02:21.949340 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:21.949360 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:21.949739 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:21.950024 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:21.950883 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:21.950888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:21.950899 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:21.950909 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:21.950959 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:21.950977 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:21.951085 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:21.951193 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 08:02:21.951356 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":134,"threads_started":1}
I20260809 08:02:21.953099 30733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e: Bootstrap starting.
I20260809 08:02:21.954840 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:21.955601 30733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:21.956415 30733 log.cc:824] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:21.958648 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:21.956915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32883 (local address 127.0.0.1:39429)
0809 08:02:21.957037 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:21.957041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:21.957273 (+ 232us) server_negotiation.cc:407] Connection header received
0809 08:02:21.957421 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:21.957427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:21.957460 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:21.957541 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:21.958284 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:21.958288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:21.958290 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:21.958302 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:21.958327 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:21.958343 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:21.958443 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:21.958502 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 08:02:21.958536 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 08:02:21.958653 30733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e: No bootstrap required, opened a new log
I20260809 08:02:21.962275 30733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } }
I20260809 08:02:21.962471 30733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:21.962503 30733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a4107707fc349f194f42b27a7fb2e3e, State: Initialized, Role: FOLLOWER
I20260809 08:02:21.962914 30733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } }
I20260809 08:02:21.963083 30733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:21.963176 30733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:21.963317 30733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:21.964090 30733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } }
I20260809 08:02:21.964401 30733 leader_election.cc:302] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a4107707fc349f194f42b27a7fb2e3e; no voters:
I20260809 08:02:21.964670 30733 leader_election.cc:288] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:21.964778 30744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:21.965034 30744 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [term 1 LEADER]: Becoming Leader. State: Replica: 8a4107707fc349f194f42b27a7fb2e3e, State: Running, Role: LEADER
I20260809 08:02:21.965417 30744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } }
I20260809 08:02:21.965888 30733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:21.966950 30745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a4107707fc349f194f42b27a7fb2e3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } } }
I20260809 08:02:21.967087 30745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:21.967418 30746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a4107707fc349f194f42b27a7fb2e3e. Latest consensus state: current_term: 1 leader_uuid: "8a4107707fc349f194f42b27a7fb2e3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4107707fc349f194f42b27a7fb2e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39429 } } }
I20260809 08:02:21.967566 30746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:21.967494 30753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:21.971220 30753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:21.976485 30753 catalog_manager.cc:1347] Generated new cluster ID: 0813fa0ac3854b9fb96c63ce25ba341d
I20260809 08:02:21.976552 30753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:21.986851 30753 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:21.987103 30753 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:21.994949 30753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a4107707fc349f194f42b27a7fb2e3e: Generated new TSK 0
I20260809 08:02:21.995576 30753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:22.005738 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30660
2026-08-09T08:02:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1408 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:22 dist-test-slave-njxd krb5kdc[30766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:22 dist-test-slave-njxd krb5kdc[30766](info): set up 2 sockets
Aug 09 08:02:22 dist-test-slave-njxd krb5kdc[30766](info): commencing operation
krb5kdc: starting...
W20260809 08:02:23.058689 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:23.187827 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42529
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:23.294016 30779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:23.294250 30779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:23.294288 30779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:23.298286 30779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:23.298341 30779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:23.298362 30779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:23.298377 30779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:23.298418 30779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:23.303574 30779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:23.304544 30779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:23.305519 30779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:23.314153 30779 server_base.cc:1034] running on GCE node
W20260809 08:02:23.314314 30787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:23.314333 30784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:23.314333 30785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:23.314992 30779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:23.316082 30779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:23.317255 30779 hybrid_clock.cc:648] HybridClock initialized: now 1786262543317236 us; error 32 us; skew 500 ppm
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262543, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:23.319924 30779 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:23.320782 30779 webserver.cc:460] Webserver started at http://127.0.0.1:36799/ using document root <none> and password file <none>
I20260809 08:02:23.321285 30779 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:23.321339 30779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:23.321492 30779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:23.323400 30779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "0ed82cd83a3647a296a9811fabddaa70"
format_stamp: "Formatted at 2026-08-09 08:02:23 on dist-test-slave-njxd"
server_key: "fea3cfff3dc20c6018ead1c40f643507"
server_key_iv: "2232fa7694d38c97ba1cbb46d6cd9f32"
server_key_version: "encryptionkey@0"
I20260809 08:02:23.323925 30779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "0ed82cd83a3647a296a9811fabddaa70"
format_stamp: "Formatted at 2026-08-09 08:02:23 on dist-test-slave-njxd"
server_key: "fea3cfff3dc20c6018ead1c40f643507"
server_key_iv: "2232fa7694d38c97ba1cbb46d6cd9f32"
server_key_version: "encryptionkey@0"
I20260809 08:02:23.327307 30779 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260809 08:02:23.329567 30795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:23.330787 30779 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:23.330925 30779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "0ed82cd83a3647a296a9811fabddaa70"
format_stamp: "Formatted at 2026-08-09 08:02:23 on dist-test-slave-njxd"
server_key: "fea3cfff3dc20c6018ead1c40f643507"
server_key_iv: "2232fa7694d38c97ba1cbb46d6cd9f32"
server_key_version: "encryptionkey@0"
I20260809 08:02:23.331037 30779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:23.346292 30779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:23.348958 30779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:23.349160 30779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:23.356420 30779 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42529
I20260809 08:02:23.356444 30848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42529 every 8 connection(s)
I20260809 08:02:23.357318 30779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:23.360162 30849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:23.364167 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30779
I20260809 08:02:23.364306 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:23.364580 8397 external_mini_cluster.cc:1428] Setting key d489e5d517e8264a32c0fbee254e1f2d
I20260809 08:02:23.365916 30849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: Bootstrap starting.
I20260809 08:02:23.368108 30849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:23.368924 30849 log.cc:824] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:23.370774 30849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: No bootstrap required, opened a new log
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 08:02:23.374910 30849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } }
I20260809 08:02:23.375141 30849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:23.375223 30849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed82cd83a3647a296a9811fabddaa70, State: Initialized, Role: FOLLOWER
I20260809 08:02:23.375685 30849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } }
I20260809 08:02:23.375854 30849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:23.375924 30849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:23.376045 30849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:23.376901 30849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } }
I20260809 08:02:23.377233 30849 leader_election.cc:302] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ed82cd83a3647a296a9811fabddaa70; no voters:
I20260809 08:02:23.377566 30849 leader_election.cc:288] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:23.377664 30854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:23.377902 30854 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed82cd83a3647a296a9811fabddaa70, State: Running, Role: LEADER
I20260809 08:02:23.378196 30854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } }
I20260809 08:02:23.378855 30849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:23.378950 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:23.365908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:51775 (local address 127.0.0.1:42529)
0809 08:02:23.366339 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:23.366361 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:23.366394 (+ 33us) server_negotiation.cc:407] Connection header received
0809 08:02:23.366952 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:23.366966 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:23.367274 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:23.367518 (+ 244us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:23.368412 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:23.369443 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:23.370377 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:23.370842 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:23.371014 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:23.373794 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:23.373799 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:23.373811 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:23.373835 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:23.375689 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:23.376265 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:23.376270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:23.376275 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:23.376415 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:23.376792 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:23.376795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:23.376796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:23.377217 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:23.377436 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:23.377810 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 08:02:23.378199 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":137,"threads_started":1}
I20260809 08:02:23.379323 30854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ed82cd83a3647a296a9811fabddaa70. Latest consensus state: current_term: 1 leader_uuid: "0ed82cd83a3647a296a9811fabddaa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } } }
I20260809 08:02:23.379423 30856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ed82cd83a3647a296a9811fabddaa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed82cd83a3647a296a9811fabddaa70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42529 } } }
I20260809 08:02:23.379498 30854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:23.379675 30856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:23.382292 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 08:02:23.384373 30872 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:23.384519 30872 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:23.384675 30864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:23.385370 30864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:23.391090 30864 catalog_manager.cc:1347] Generated new cluster ID: 80362e3777964b3a82cacbd905857689
I20260809 08:02:23.391152 30864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:23.393705 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:23.384555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:58433 (local address 127.0.0.1:42529)
0809 08:02:23.384672 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:23.384677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:23.384913 (+ 236us) server_negotiation.cc:407] Connection header received
0809 08:02:23.385046 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:23.385048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:23.385094 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:23.385178 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:23.386015 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:23.386729 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:23.387884 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:23.388191 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:23.388290 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:23.390295 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:23.390298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:23.390301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:23.390324 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:23.391866 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:23.392332 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:23.392337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:23.392343 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:23.392417 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:23.392779 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:23.392783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:23.392784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:23.392959 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:23.393115 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:23.393373 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 08:02:23.393463 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 08:02:23.415099 30864 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:23.416102 30864 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:23.422722 30864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ed82cd83a3647a296a9811fabddaa70: Generated new TSK 0
I20260809 08:02:23.423395 30864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:23.426865 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30779
W20260809 08:02:23.434305 30763 connection.cc:535] client connection to 127.0.0.1:42529 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42529): Connection reset by peer (error 104)
2026-08-09T08:02:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30884](info): set up 2 sockets
Aug 09 08:02:23 dist-test-slave-njxd krb5kdc[30884](info): commencing operation
krb5kdc: starting...
W20260809 08:02:24.470655 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:24 dist-test-slave-njxd krb5kdc[30884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:24.597289 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45045
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:24.707727 30897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:24.708011 30897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:24.708084 30897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:24.712116 30897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:24.712193 30897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:24.712229 30897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:24.712281 30897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:24.712313 30897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:24.717300 30897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:24.718513 30897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:24.719565 30897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:24.727705 30904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:24.727782 30897 server_base.cc:1034] running on GCE node
W20260809 08:02:24.727824 30906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:24.727713 30902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:24.728538 30897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:24.729714 30897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:24.730897 30897 hybrid_clock.cc:648] HybridClock initialized: now 1786262544730882 us; error 31 us; skew 500 ppm
Aug 09 08:02:24 dist-test-slave-njxd krb5kdc[30884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262544, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:24.736972 30897 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:24.737884 30897 webserver.cc:460] Webserver started at http://127.0.0.1:39719/ using document root <none> and password file <none>
I20260809 08:02:24.738431 30897 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:24.738524 30897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:24.738765 30897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:24.740775 30897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "c54e6989f12f4c4fb9f61cffb180b4ce"
format_stamp: "Formatted at 2026-08-09 08:02:24 on dist-test-slave-njxd"
server_key: "e02ea9ff1dd8f21d21ac6884dbd69c96"
server_key_iv: "58e0c9aa296eea67434f19e71880c30c"
server_key_version: "encryptionkey@0"
I20260809 08:02:24.741344 30897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "c54e6989f12f4c4fb9f61cffb180b4ce"
format_stamp: "Formatted at 2026-08-09 08:02:24 on dist-test-slave-njxd"
server_key: "e02ea9ff1dd8f21d21ac6884dbd69c96"
server_key_iv: "58e0c9aa296eea67434f19e71880c30c"
server_key_version: "encryptionkey@0"
I20260809 08:02:24.744959 30897 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:02:24.747396 30913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:24.748534 30897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 08:02:24.748687 30897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "c54e6989f12f4c4fb9f61cffb180b4ce"
format_stamp: "Formatted at 2026-08-09 08:02:24 on dist-test-slave-njxd"
server_key: "e02ea9ff1dd8f21d21ac6884dbd69c96"
server_key_iv: "58e0c9aa296eea67434f19e71880c30c"
server_key_version: "encryptionkey@0"
I20260809 08:02:24.748806 30897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:24.780192 30897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:24.783013 30897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:24.783166 30897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:24.790586 30897 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45045
I20260809 08:02:24.790602 30969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45045 every 8 connection(s)
I20260809 08:02:24.791512 30897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:24.794296 30970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:24.794446 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 30897
I20260809 08:02:24.794631 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:24.794924 8397 external_mini_cluster.cc:1428] Setting key ca0483d537f2d8370b8642aef1fcb6bc
I20260809 08:02:24.800565 30970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce: Bootstrap starting.
I20260809 08:02:24.802795 30970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:24.803613 30970 log.cc:824] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:24.803906 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:24.796336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:55913 (local address 127.0.0.1:45045)
0809 08:02:24.796752 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:24.796767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:24.796802 (+ 35us) server_negotiation.cc:407] Connection header received
0809 08:02:24.797471 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:24.797488 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:24.797880 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:24.798212 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:24.798604 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:24.799632 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:24.800587 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:24.801113 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:24.801288 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:24.802218 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:24.802223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:24.802235 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:24.802594 (+ 359us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:24.802644 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:24.802665 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:24.802809 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:24.802993 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 08:02:24.803138 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":126,"threads_started":1}
I20260809 08:02:24.805583 30970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce: No bootstrap required, opened a new log
I20260809 08:02:24.807009 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:24.809356 30970 raft_consensus.cc:348] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } }
I20260809 08:02:24.809693 30970 raft_consensus.cc:374] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:24.809782 30970 raft_consensus.cc:729] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e6989f12f4c4fb9f61cffb180b4ce, State: Initialized, Role: FOLLOWER
I20260809 08:02:24.810253 30970 consensus_queue.cc:260] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } }
I20260809 08:02:24.810408 30970 raft_consensus.cc:388] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:24.810503 30970 raft_consensus.cc:482] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:24.810606 30970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:24.811640 30970 raft_consensus.cc:504] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } }
I20260809 08:02:24.811978 30970 leader_election.cc:302] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c54e6989f12f4c4fb9f61cffb180b4ce; no voters:
I20260809 08:02:24.812350 30970 leader_election.cc:288] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:24.812426 30980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:24.812704 30980 raft_consensus.cc:686] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [term 1 LEADER]: Becoming Leader. State: Replica: c54e6989f12f4c4fb9f61cffb180b4ce, State: Running, Role: LEADER
I20260809 08:02:24.813024 30980 consensus_queue.cc:237] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } }
I20260809 08:02:24.813511 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:24.808986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:53383 (local address 127.0.0.1:45045)
0809 08:02:24.809107 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:24.809111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:24.809319 (+ 208us) server_negotiation.cc:407] Connection header received
0809 08:02:24.809432 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:24.809434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:24.809488 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:24.809551 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:24.809966 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:24.810530 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:24.811686 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:24.811958 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:24.812036 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:24.812948 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:24.812952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:24.812954 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:24.812966 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:24.812993 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:24.813005 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:24.813098 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:24.813367 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 08:02:24.813399 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 08:02:24.813702 30970 sys_catalog.cc:564] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:24.815032 30983 sys_catalog.cc:455] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } } }
I20260809 08:02:24.815065 30981 sys_catalog.cc:455] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader c54e6989f12f4c4fb9f61cffb180b4ce. Latest consensus state: current_term: 1 leader_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54e6989f12f4c4fb9f61cffb180b4ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45045 } } }
I20260809 08:02:24.815186 30983 sys_catalog.cc:458] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:24.815188 30981 sys_catalog.cc:458] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:24.815623 30990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:24.818284 30990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:24.824205 30990 catalog_manager.cc:1347] Generated new cluster ID: f2321391e703444f984b98d2cdbe59ab
I20260809 08:02:24.824270 30990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:24.837430 30990 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:24.838675 30990 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:24.847500 30990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c54e6989f12f4c4fb9f61cffb180b4ce: Generated new TSK 0
I20260809 08:02:24.848351 30990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:24.852309 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 30897
W20260809 08:02:24.859630 30881 connection.cc:535] client connection to 127.0.0.1:45045 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45045): Connection reset by peer (error 104)
2026-08-09T08:02:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:24 dist-test-slave-njxd krb5kdc[31003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:24 dist-test-slave-njxd krb5kdc[31003](info): set up 2 sockets
Aug 09 08:02:24 dist-test-slave-njxd krb5kdc[31003](info): commencing operation
krb5kdc: starting...
W20260809 08:02:25.914803 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:25 dist-test-slave-njxd krb5kdc[31003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:26.037204 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42201
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:26.145081 31017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:26.145375 31017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:26.145457 31017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:26.149240 31017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:26.149325 31017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:26.149361 31017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:26.149394 31017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:26.149421 31017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:26.155092 31017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:26.156114 31017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:26.157109 31017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:26.165501 31022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:26.165539 31027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:26.165501 31023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:26.165808 31017 server_base.cc:1034] running on GCE node
I20260809 08:02:26.166389 31017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:26.167413 31017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:26.168573 31017 hybrid_clock.cc:648] HybridClock initialized: now 1786262546168542 us; error 43 us; skew 500 ppm
Aug 09 08:02:26 dist-test-slave-njxd krb5kdc[31003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262546, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:26.171337 31017 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:26.172189 31017 webserver.cc:460] Webserver started at http://127.0.0.1:43431/ using document root <none> and password file <none>
I20260809 08:02:26.172770 31017 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:26.172863 31017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:26.173116 31017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:26.175232 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "e69992d8282f4768a003736fd6674eeb"
format_stamp: "Formatted at 2026-08-09 08:02:26 on dist-test-slave-njxd"
server_key: "595c9286a1aac727ab696d5efb8b247d"
server_key_iv: "35c51cfb8be563b3a779b952a9f2f6ff"
server_key_version: "encryptionkey@0"
I20260809 08:02:26.175809 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "e69992d8282f4768a003736fd6674eeb"
format_stamp: "Formatted at 2026-08-09 08:02:26 on dist-test-slave-njxd"
server_key: "595c9286a1aac727ab696d5efb8b247d"
server_key_iv: "35c51cfb8be563b3a779b952a9f2f6ff"
server_key_version: "encryptionkey@0"
I20260809 08:02:26.179479 31017 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 08:02:26.181819 31035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:26.182991 31017 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:26.183130 31017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "e69992d8282f4768a003736fd6674eeb"
format_stamp: "Formatted at 2026-08-09 08:02:26 on dist-test-slave-njxd"
server_key: "595c9286a1aac727ab696d5efb8b247d"
server_key_iv: "35c51cfb8be563b3a779b952a9f2f6ff"
server_key_version: "encryptionkey@0"
I20260809 08:02:26.183236 31017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:26.187528 31017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:26.190282 31017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:26.190469 31017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:26.196944 31017 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42201
I20260809 08:02:26.197002 31089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42201 every 8 connection(s)
I20260809 08:02:26.197844 31017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:26.200387 31090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:26.203300 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31017
I20260809 08:02:26.203454 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:26.203779 8397 external_mini_cluster.cc:1428] Setting key 7376b8ac8b80ed0d81434774d1a10e57
I20260809 08:02:26.206489 31090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb: Bootstrap starting.
I20260809 08:02:26.208717 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:26.205045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:37033 (local address 127.0.0.1:42201)
0809 08:02:26.205459 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:26.205472 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:26.205506 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:02:26.206212 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:26.206229 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:26.206480 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:26.206784 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:26.207560 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:26.207564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:26.207574 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:26.207591 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:26.207639 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:26.207656 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:26.207754 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:26.207882 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 08:02:26.208040 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":126,"threads_started":1}
I20260809 08:02:26.208899 31090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:26.209692 31090 log.cc:824] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:26.211524 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:26.211779 31090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb: No bootstrap required, opened a new log
I20260809 08:02:26.215116 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:26.213472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:34707 (local address 127.0.0.1:42201)
0809 08:02:26.213638 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:26.213642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:26.213795 (+ 153us) server_negotiation.cc:407] Connection header received
0809 08:02:26.213910 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:26.213913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:26.213942 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:26.214049 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:26.214744 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:26.214748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:26.214751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:26.214762 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:26.214786 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:26.214800 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:26.214893 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:26.214966 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 08:02:26.215004 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:26.215581 31090 raft_consensus.cc:348] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } }
I20260809 08:02:26.215799 31090 raft_consensus.cc:374] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:26.215857 31090 raft_consensus.cc:729] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e69992d8282f4768a003736fd6674eeb, State: Initialized, Role: FOLLOWER
I20260809 08:02:26.216296 31090 consensus_queue.cc:260] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } }
I20260809 08:02:26.216467 31090 raft_consensus.cc:388] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:26.216550 31090 raft_consensus.cc:482] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:26.216671 31090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:26.217479 31090 raft_consensus.cc:504] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } }
I20260809 08:02:26.217830 31090 leader_election.cc:302] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e69992d8282f4768a003736fd6674eeb; no voters:
I20260809 08:02:26.218111 31090 leader_election.cc:288] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:26.218217 31100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:26.218418 31100 raft_consensus.cc:686] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [term 1 LEADER]: Becoming Leader. State: Replica: e69992d8282f4768a003736fd6674eeb, State: Running, Role: LEADER
I20260809 08:02:26.218760 31100 consensus_queue.cc:237] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } }
I20260809 08:02:26.219287 31090 sys_catalog.cc:564] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:26.220387 31101 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e69992d8282f4768a003736fd6674eeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } } }
I20260809 08:02:26.220511 31101 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:26.220903 31109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:26.220871 31102 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e69992d8282f4768a003736fd6674eeb. Latest consensus state: current_term: 1 leader_uuid: "e69992d8282f4768a003736fd6674eeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69992d8282f4768a003736fd6674eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42201 } } }
I20260809 08:02:26.221521 31102 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:26.223702 31109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:26.228933 31109 catalog_manager.cc:1347] Generated new cluster ID: 83081d0988a74a61aae7726e89125cf4
I20260809 08:02:26.228997 31109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:26.251163 31109 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:26.251531 31109 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:26.261963 31109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e69992d8282f4768a003736fd6674eeb: Generated new TSK 0
I20260809 08:02:26.262595 31109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:26.276314 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31017
2026-08-09T08:02:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:26 dist-test-slave-njxd krb5kdc[31122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:26 dist-test-slave-njxd krb5kdc[31122](info): set up 2 sockets
Aug 09 08:02:26 dist-test-slave-njxd krb5kdc[31122](info): commencing operation
krb5kdc: starting...
W20260809 08:02:27.334790 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:27.461030 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33419
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:27.573467 31135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:27.573827 31135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:27.573918 31135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:27.577984 31135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:27.578083 31135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:27.578122 31135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:27.578177 31135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:27.578217 31135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:27.583516 31135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33419
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:27.584636 31135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:27.585742 31135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:27.594303 31135 server_base.cc:1034] running on GCE node
W20260809 08:02:27.594252 31140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:27.594293 31141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:27.594236 31143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:27.595085 31135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:27.596128 31135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:27.597277 31135 hybrid_clock.cc:648] HybridClock initialized: now 1786262547597262 us; error 26 us; skew 500 ppm
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262547, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:27.600126 31135 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:27.600982 31135 webserver.cc:460] Webserver started at http://127.0.0.1:46039/ using document root <none> and password file <none>
I20260809 08:02:27.601540 31135 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:27.601672 31135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:27.601907 31135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:27.603935 31135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "3edcbee2ed2b4af3ad620c8dc33492b6"
format_stamp: "Formatted at 2026-08-09 08:02:27 on dist-test-slave-njxd"
server_key: "47afee0be25e2943678e7583e6cfd191"
server_key_iv: "f97c6d698477bb69d5a8bf8f1f5998fa"
server_key_version: "encryptionkey@0"
I20260809 08:02:27.604506 31135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "3edcbee2ed2b4af3ad620c8dc33492b6"
format_stamp: "Formatted at 2026-08-09 08:02:27 on dist-test-slave-njxd"
server_key: "47afee0be25e2943678e7583e6cfd191"
server_key_iv: "f97c6d698477bb69d5a8bf8f1f5998fa"
server_key_version: "encryptionkey@0"
I20260809 08:02:27.608522 31135 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 08:02:27.611073 31150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:27.612282 31135 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:02:27.612422 31135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "3edcbee2ed2b4af3ad620c8dc33492b6"
format_stamp: "Formatted at 2026-08-09 08:02:27 on dist-test-slave-njxd"
server_key: "47afee0be25e2943678e7583e6cfd191"
server_key_iv: "f97c6d698477bb69d5a8bf8f1f5998fa"
server_key_version: "encryptionkey@0"
I20260809 08:02:27.612540 31135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:27.630734 31135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:27.634195 31135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:27.634413 31135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:27.641340 31135 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33419
I20260809 08:02:27.641423 31204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33419 every 8 connection(s)
I20260809 08:02:27.642354 31135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:27.645056 31205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:27.648105 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31135
I20260809 08:02:27.648217 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:27.648496 8397 external_mini_cluster.cc:1428] Setting key 6d85c421c87403694da45fa9cce5fbbb
I20260809 08:02:27.651005 31205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6: Bootstrap starting.
I20260809 08:02:27.653668 31205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:27.654627 31205 log.cc:824] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:27.656946 31205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6: No bootstrap required, opened a new log
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 08:02:27.660554 31205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } }
I20260809 08:02:27.660807 31205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:27.660889 31205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3edcbee2ed2b4af3ad620c8dc33492b6, State: Initialized, Role: FOLLOWER
I20260809 08:02:27.661429 31205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } }
I20260809 08:02:27.661628 31205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:27.661705 31205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:27.661816 31205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:27.662962 31205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } }
I20260809 08:02:27.663341 31205 leader_election.cc:302] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3edcbee2ed2b4af3ad620c8dc33492b6; no voters:
I20260809 08:02:27.663681 31205 leader_election.cc:288] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:27.663784 31210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:27.663982 31208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:27.649912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:46087 (local address 127.0.0.1:33419)
0809 08:02:27.650341 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:27.650359 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:27.650396 (+ 37us) server_negotiation.cc:407] Connection header received
0809 08:02:27.650993 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:27.651009 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:27.651412 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:27.651699 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:27.652694 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:27.653813 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:27.655028 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:27.655665 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:27.655788 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:27.658726 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:27.658732 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:27.658746 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:27.658773 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:27.660489 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:27.661113 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:27.661118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:27.661123 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:27.661232 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:27.661694 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:27.661697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:27.661699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:27.662173 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:27.662344 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:27.662712 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 08:02:27.662976 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":139,"threads_started":1}
I20260809 08:02:27.664050 31210 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [term 1 LEADER]: Becoming Leader. State: Replica: 3edcbee2ed2b4af3ad620c8dc33492b6, State: Running, Role: LEADER
I20260809 08:02:27.664633 31210 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } }
I20260809 08:02:27.665112 31205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:27.666242 31212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3edcbee2ed2b4af3ad620c8dc33492b6. Latest consensus state: current_term: 1 leader_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } } }
I20260809 08:02:27.666402 31212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:27.666508 31211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edcbee2ed2b4af3ad620c8dc33492b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33419 } } }
I20260809 08:02:27.666676 31211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:27.667049 31219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:27.667907 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:27.670722 31219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:27.676564 31219 catalog_manager.cc:1347] Generated new cluster ID: 2c5bd02651284a20a59ef74a80a27ebf
I20260809 08:02:27.676633 31219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:27.681962 31208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:27.670166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:43237 (local address 127.0.0.1:33419)
0809 08:02:27.670291 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:27.670295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:27.673181 (+ 2886us) server_negotiation.cc:407] Connection header received
0809 08:02:27.673306 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:27.673309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:27.673356 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:27.673438 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:27.674380 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:27.674943 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:27.676062 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:27.676454 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:27.676558 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:27.678417 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:27.678420 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:27.678423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:27.678447 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:27.680109 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:27.680689 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:27.680692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:27.680694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:27.680772 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:27.681124 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:27.681127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:27.681128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:27.681302 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:27.681445 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:27.681733 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 08:02:27.681820 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:02:27.688155 31219 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:27.689297 31219 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:27.693356 31219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3edcbee2ed2b4af3ad620c8dc33492b6: Generated new TSK 0
I20260809 08:02:27.694072 31219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:27.697535 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31135
W20260809 08:02:27.705869 31120 connection.cc:535] client connection to 127.0.0.1:33419 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33419): Connection reset by peer (error 104)
2026-08-09T08:02:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1423 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31238](info): set up 2 sockets
Aug 09 08:02:27 dist-test-slave-njxd krb5kdc[31238](info): commencing operation
krb5kdc: starting...
W20260809 08:02:28.755882 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:28 dist-test-slave-njxd krb5kdc[31238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:28.878445 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45819
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:28.983551 31252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:28.983793 31252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:28.983830 31252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:28.987515 31252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:28.987558 31252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:28.987576 31252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:28.987591 31252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:28.987607 31252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:28.992441 31252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45819
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:28.993299 31252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:28.994232 31252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:29.002552 31257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:29.002678 31252 server_base.cc:1034] running on GCE node
W20260809 08:02:29.002552 31260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:29.002619 31258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:29.003376 31252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:29.004396 31252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:29.005620 31252 hybrid_clock.cc:648] HybridClock initialized: now 1786262549005561 us; error 32 us; skew 500 ppm
Aug 09 08:02:29 dist-test-slave-njxd krb5kdc[31238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262549, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:29.008378 31252 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:29.009158 31252 webserver.cc:460] Webserver started at http://127.0.0.1:41739/ using document root <none> and password file <none>
I20260809 08:02:29.009776 31252 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:29.009836 31252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:29.009989 31252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:29.011905 31252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "11fe1a4d4c344e20a6560deb23a657bd"
format_stamp: "Formatted at 2026-08-09 08:02:29 on dist-test-slave-njxd"
server_key: "7c53f72c65195458916289a41f3aeeb6"
server_key_iv: "caced143907f6ca400aa09d87efb4898"
server_key_version: "encryptionkey@0"
I20260809 08:02:29.012413 31252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "11fe1a4d4c344e20a6560deb23a657bd"
format_stamp: "Formatted at 2026-08-09 08:02:29 on dist-test-slave-njxd"
server_key: "7c53f72c65195458916289a41f3aeeb6"
server_key_iv: "caced143907f6ca400aa09d87efb4898"
server_key_version: "encryptionkey@0"
I20260809 08:02:29.016069 31252 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 08:02:29.018363 31267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:29.019548 31252 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:29.019688 31252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "11fe1a4d4c344e20a6560deb23a657bd"
format_stamp: "Formatted at 2026-08-09 08:02:29 on dist-test-slave-njxd"
server_key: "7c53f72c65195458916289a41f3aeeb6"
server_key_iv: "caced143907f6ca400aa09d87efb4898"
server_key_version: "encryptionkey@0"
I20260809 08:02:29.019796 31252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:29.038406 31252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:29.041709 31252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:29.041927 31252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:29.048905 31252 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45819
I20260809 08:02:29.048931 31327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45819 every 8 connection(s)
I20260809 08:02:29.049849 31252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:29.052505 31328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:29.054086 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31252
I20260809 08:02:29.054224 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:29.054536 8397 external_mini_cluster.cc:1428] Setting key 5679dd064f337e72bb48a38e3510c49c
I20260809 08:02:29.058717 31328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: Bootstrap starting.
I20260809 08:02:29.060931 31328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:29.061698 31328 log.cc:824] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:29.063584 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:29.055972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:49293 (local address 127.0.0.1:45819)
0809 08:02:29.056468 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:29.056481 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:29.056515 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:02:29.057213 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:29.057229 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:29.057542 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:29.057955 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:29.058360 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:29.059380 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:29.060287 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:29.060757 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:29.060920 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:29.061854 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:29.061859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:29.061871 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:29.062361 (+ 490us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:29.062429 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:29.062462 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:29.062611 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:29.062795 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 08:02:29.062938 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":136,"threads_started":1}
I20260809 08:02:29.063684 31328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: No bootstrap required, opened a new log
I20260809 08:02:29.066361 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:29.067610 31328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } }
I20260809 08:02:29.067838 31328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:29.067909 31328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11fe1a4d4c344e20a6560deb23a657bd, State: Initialized, Role: FOLLOWER
I20260809 08:02:29.068388 31328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } }
I20260809 08:02:29.068603 31328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:29.068681 31328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:29.068804 31328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:29.069949 31328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } }
I20260809 08:02:29.070374 31328 leader_election.cc:302] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11fe1a4d4c344e20a6560deb23a657bd; no voters:
I20260809 08:02:29.070734 31328 leader_election.cc:288] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:29.071146 31339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:29.071487 31339 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [term 1 LEADER]: Becoming Leader. State: Replica: 11fe1a4d4c344e20a6560deb23a657bd, State: Running, Role: LEADER
I20260809 08:02:29.072057 31328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:29.072016 31339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } }
I20260809 08:02:29.073516 31339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11fe1a4d4c344e20a6560deb23a657bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } } }
I20260809 08:02:29.073725 31339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:29.074134 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:29.068237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:35965 (local address 127.0.0.1:45819)
0809 08:02:29.068357 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:29.068361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:29.068522 (+ 161us) server_negotiation.cc:407] Connection header received
0809 08:02:29.068581 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:29.068584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:29.068632 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:29.068716 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:29.069026 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:29.069866 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:29.071277 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:29.071819 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:29.071912 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:29.073148 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:29.073156 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:29.073160 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:29.073176 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:29.073228 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:29.073251 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:29.073355 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:29.073819 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 08:02:29.073858 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 08:02:29.073963 31339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11fe1a4d4c344e20a6560deb23a657bd. Latest consensus state: current_term: 1 leader_uuid: "11fe1a4d4c344e20a6560deb23a657bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fe1a4d4c344e20a6560deb23a657bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45819 } } }
I20260809 08:02:29.074481 31339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:29.077868 31353 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:29.077941 31353 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:29.078969 31352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:29.079788 31352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:29.084619 31352 catalog_manager.cc:1347] Generated new cluster ID: d213b312c6b1431aa175f8f11bdd140e
I20260809 08:02:29.084679 31352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:29.097173 31352 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:29.098277 31352 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:29.109812 31352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11fe1a4d4c344e20a6560deb23a657bd: Generated new TSK 0
I20260809 08:02:29.110471 31352 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:29.116084 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31252
W20260809 08:02:29.123219 31236 connection.cc:535] client connection to 127.0.0.1:45819 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45819): Connection reset by peer (error 104)
2026-08-09T08:02:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:29 dist-test-slave-njxd krb5kdc[31359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:29 dist-test-slave-njxd krb5kdc[31359](info): set up 2 sockets
Aug 09 08:02:29 dist-test-slave-njxd krb5kdc[31359](info): commencing operation
krb5kdc: starting...
W20260809 08:02:30.168679 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:30 dist-test-slave-njxd krb5kdc[31359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 08:02:30.292873 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37179
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:30.402830 31373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:30.403126 31373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:30.403208 31373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:30.407078 31373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:30.407156 31373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:30.407192 31373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:30.407248 31373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:30.407289 31373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:30.412503 31373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37179
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:30.413556 31373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:30.414592 31373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:30.422817 31383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:30.422823 31379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:30.422828 31380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:30.422991 31373 server_base.cc:1034] running on GCE node
I20260809 08:02:30.423664 31373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:30.424685 31373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:30.425861 31373 hybrid_clock.cc:648] HybridClock initialized: now 1786262550425846 us; error 52 us; skew 500 ppm
Aug 09 08:02:30 dist-test-slave-njxd krb5kdc[31359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262550, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:30.431632 31373 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 08:02:30.432535 31373 webserver.cc:460] Webserver started at http://127.0.0.1:42543/ using document root <none> and password file <none>
I20260809 08:02:30.433095 31373 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:30.433185 31373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:30.433413 31373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:30.435479 31373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "7a23f08e33034bd2a326a8478b707d03"
format_stamp: "Formatted at 2026-08-09 08:02:30 on dist-test-slave-njxd"
server_key: "d8040f112009fa92199b9587ba9c3f7c"
server_key_iv: "440d17a77168f12adad6c1dcd3b07b07"
server_key_version: "encryptionkey@0"
I20260809 08:02:30.436057 31373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "7a23f08e33034bd2a326a8478b707d03"
format_stamp: "Formatted at 2026-08-09 08:02:30 on dist-test-slave-njxd"
server_key: "d8040f112009fa92199b9587ba9c3f7c"
server_key_iv: "440d17a77168f12adad6c1dcd3b07b07"
server_key_version: "encryptionkey@0"
I20260809 08:02:30.439868 31373 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 08:02:30.442277 31392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:30.443459 31373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:30.443598 31373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "7a23f08e33034bd2a326a8478b707d03"
format_stamp: "Formatted at 2026-08-09 08:02:30 on dist-test-slave-njxd"
server_key: "d8040f112009fa92199b9587ba9c3f7c"
server_key_iv: "440d17a77168f12adad6c1dcd3b07b07"
server_key_version: "encryptionkey@0"
I20260809 08:02:30.443711 31373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:30.448338 31373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:30.451273 31373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:30.451463 31373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:30.458225 31373 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37179
I20260809 08:02:30.458341 31447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37179 every 8 connection(s)
I20260809 08:02:30.459172 31373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:30.459468 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31373
I20260809 08:02:30.459619 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:30.459959 8397 external_mini_cluster.cc:1428] Setting key f22e253b0a23d0b833b1bfad90b61556
I20260809 08:02:30.462471 31448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:30.465637 31451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:30.461382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:37575 (local address 127.0.0.1:37179)
0809 08:02:30.461809 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:30.461829 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:30.461875 (+ 46us) server_negotiation.cc:407] Connection header received
0809 08:02:30.462728 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:30.462751 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:30.463115 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:30.463477 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:30.464205 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:30.464211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:30.464226 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:30.464240 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:30.464304 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:30.464330 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:30.464469 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:30.464537 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 08:02:30.464691 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":158,"threads_started":1}
I20260809 08:02:30.468479 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:30.469350 31448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03: Bootstrap starting.
I20260809 08:02:30.471840 31448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:30.472259 31451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:30.470610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:39089 (local address 127.0.0.1:37179)
0809 08:02:30.470729 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:30.470735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:30.470921 (+ 186us) server_negotiation.cc:407] Connection header received
0809 08:02:30.471053 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:30.471056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:30.471093 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:30.471176 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:30.471893 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:30.471897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:30.471899 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:30.471911 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:30.471939 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:30.471950 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:30.472023 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:30.472107 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 08:02:30.472148 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 08:02:30.472762 31448 log.cc:824] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:30.474750 31448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03: No bootstrap required, opened a new log
I20260809 08:02:30.478072 31448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } }
I20260809 08:02:30.478317 31448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:30.478384 31448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a23f08e33034bd2a326a8478b707d03, State: Initialized, Role: FOLLOWER
I20260809 08:02:30.478876 31448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } }
I20260809 08:02:30.479043 31448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:30.479120 31448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:30.479219 31448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:30.480078 31448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } }
I20260809 08:02:30.480424 31448 leader_election.cc:302] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a23f08e33034bd2a326a8478b707d03; no voters:
I20260809 08:02:30.480737 31448 leader_election.cc:288] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:30.480846 31458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:30.481103 31458 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [term 1 LEADER]: Becoming Leader. State: Replica: 7a23f08e33034bd2a326a8478b707d03, State: Running, Role: LEADER
I20260809 08:02:30.481416 31458 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } }
I20260809 08:02:30.481949 31448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:30.483026 31460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a23f08e33034bd2a326a8478b707d03. Latest consensus state: current_term: 1 leader_uuid: "7a23f08e33034bd2a326a8478b707d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } } }
I20260809 08:02:30.483165 31460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:30.483587 31468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:30.483544 31459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a23f08e33034bd2a326a8478b707d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a23f08e33034bd2a326a8478b707d03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37179 } } }
I20260809 08:02:30.483706 31459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:30.486420 31468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:30.492340 31468 catalog_manager.cc:1347] Generated new cluster ID: c35b85fb5a004deaac8cddfd47cd2fbd
I20260809 08:02:30.492419 31468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:30.512229 31468 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:30.512564 31468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:30.530787 31468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a23f08e33034bd2a326a8478b707d03: Generated new TSK 0
I20260809 08:02:30.531535 31468 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:30.541728 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31373
2026-08-09T08:02:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:30 dist-test-slave-njxd krb5kdc[31480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:30 dist-test-slave-njxd krb5kdc[31480](info): set up 2 sockets
Aug 09 08:02:30 dist-test-slave-njxd krb5kdc[31480](info): commencing operation
krb5kdc: starting...
W20260809 08:02:31.615842 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:31 dist-test-slave-njxd krb5kdc[31480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:31.748494 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:37551
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:37551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:31.856983 31493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:31.857230 31493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:31.857316 31493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:31.861392 31493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:31.861454 31493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:31.861474 31493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:31.861492 31493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:31.861507 31493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:31.866698 31493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:37551
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:37551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:31.867744 31493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:31.868772 31493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:31.877223 31501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:31.877300 31493 server_base.cc:1034] running on GCE node
W20260809 08:02:31.877262 31498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:31.877259 31499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:31.878057 31493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:31.879238 31493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:31.880403 31493 hybrid_clock.cc:648] HybridClock initialized: now 1786262551880383 us; error 37 us; skew 500 ppm
Aug 09 08:02:31 dist-test-slave-njxd krb5kdc[31480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262551, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:31.883183 31493 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:31.883996 31493 webserver.cc:460] Webserver started at http://127.8.51.126:35953/ using document root <none> and password file <none>
I20260809 08:02:31.884505 31493 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:31.884558 31493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:31.884722 31493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:31.886723 31493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "d632bde8660f4fb3b946e53a86bbcf6b"
format_stamp: "Formatted at 2026-08-09 08:02:31 on dist-test-slave-njxd"
server_key: "9d798a0bbf715cc24643b60415375fb8"
server_key_iv: "4b4ce09f6dca966df3020b8217319729"
server_key_version: "encryptionkey@0"
I20260809 08:02:31.887225 31493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "d632bde8660f4fb3b946e53a86bbcf6b"
format_stamp: "Formatted at 2026-08-09 08:02:31 on dist-test-slave-njxd"
server_key: "9d798a0bbf715cc24643b60415375fb8"
server_key_iv: "4b4ce09f6dca966df3020b8217319729"
server_key_version: "encryptionkey@0"
I20260809 08:02:31.891343 31493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:02:31.893570 31508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:31.894837 31493 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:31.894971 31493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "d632bde8660f4fb3b946e53a86bbcf6b"
format_stamp: "Formatted at 2026-08-09 08:02:31 on dist-test-slave-njxd"
server_key: "9d798a0bbf715cc24643b60415375fb8"
server_key_iv: "4b4ce09f6dca966df3020b8217319729"
server_key_version: "encryptionkey@0"
I20260809 08:02:31.895087 31493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:31.917418 31493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:31.920440 31493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:31.920655 31493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:31.928031 31493 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:37551
I20260809 08:02:31.928058 31565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:37551 every 8 connection(s)
I20260809 08:02:31.928990 31493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:31.931727 31566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:31.935295 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31493
I20260809 08:02:31.935443 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:31.935734 8397 external_mini_cluster.cc:1428] Setting key b753a021955b76e86c699c2e3f1d7592
I20260809 08:02:31.937951 31566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b: Bootstrap starting.
I20260809 08:02:31.940255 31566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:31.941038 31566 log.cc:824] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:31.943089 31566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b: No bootstrap required, opened a new log
Aug 09 08:02:31 dist-test-slave-njxd krb5kdc[31480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:31.947126 31566 raft_consensus.cc:348] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } }
I20260809 08:02:31.947409 31566 raft_consensus.cc:374] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:31.947499 31566 raft_consensus.cc:729] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d632bde8660f4fb3b946e53a86bbcf6b, State: Initialized, Role: FOLLOWER
I20260809 08:02:31.947997 31566 consensus_queue.cc:260] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } }
I20260809 08:02:31.948158 31566 raft_consensus.cc:388] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:31.948251 31566 raft_consensus.cc:482] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:31.948386 31566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:31.949388 31566 raft_consensus.cc:504] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } }
I20260809 08:02:31.949841 31566 leader_election.cc:302] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d632bde8660f4fb3b946e53a86bbcf6b; no voters:
I20260809 08:02:31.950243 31566 leader_election.cc:288] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:31.950366 31571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:31.950599 31571 raft_consensus.cc:686] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [term 1 LEADER]: Becoming Leader. State: Replica: d632bde8660f4fb3b946e53a86bbcf6b, State: Running, Role: LEADER
I20260809 08:02:31.950912 31571 consensus_queue.cc:237] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } }
I20260809 08:02:31.951098 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:31.937212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50431 (local address 127.8.51.126:37551)
0809 08:02:31.937723 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:31.937739 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:31.937776 (+ 37us) server_negotiation.cc:407] Connection header received
0809 08:02:31.938469 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:31.938488 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:31.938874 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:31.939217 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:31.940062 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:31.941143 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:31.942182 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:31.942663 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:31.942875 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:31.945502 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:31.945507 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:31.945522 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:31.945552 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:31.947442 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:31.948071 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:31.948077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:31.948092 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:31.948262 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:31.948668 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:31.948671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:31.948673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:31.949086 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:31.949317 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:31.949701 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 08:02:31.949947 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":146,"threads_started":1}
I20260809 08:02:31.951679 31566 sys_catalog.cc:564] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:31.952183 31571 sys_catalog.cc:455] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d632bde8660f4fb3b946e53a86bbcf6b. Latest consensus state: current_term: 1 leader_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } } }
I20260809 08:02:31.952294 31571 sys_catalog.cc:458] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:31.952646 31572 sys_catalog.cc:455] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d632bde8660f4fb3b946e53a86bbcf6b" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 37551 } } }
I20260809 08:02:31.952755 31572 sys_catalog.cc:458] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:31.953408 31575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:31.954663 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:31.957315 31575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:31.966012 31575 catalog_manager.cc:1347] Generated new cluster ID: 0d9c52ada595444d8c34a5ffbbb17329
I20260809 08:02:31.966084 31575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:31.967594 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:31.956923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57659 (local address 127.8.51.126:37551)
0809 08:02:31.957028 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:31.957032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:31.957535 (+ 503us) server_negotiation.cc:407] Connection header received
0809 08:02:31.957775 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:31.957779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:31.957830 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:31.957884 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:31.958949 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:31.959746 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:31.961052 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:31.961287 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:31.961374 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:31.963333 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:31.963338 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:31.963340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:31.963368 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:31.965388 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:31.966060 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:31.966065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:31.966067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:31.966192 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:31.966629 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:31.966632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:31.966634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:31.966862 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:31.967016 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:31.967340 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 08:02:31.967442 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 08:02:31.982095 31575 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:31.983419 31575 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:31.988566 31575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d632bde8660f4fb3b946e53a86bbcf6b: Generated new TSK 0
I20260809 08:02:31.989390 31575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:31.994642 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31493
W20260809 08:02:32.003228 31478 connection.cc:535] client connection to 127.8.51.126:37551 recv error: Network error: failed to read from TLS socket (remote: 127.8.51.126:37551): Connection reset by peer (error 104)
2026-08-09T08:02:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:32 dist-test-slave-njxd krb5kdc[31597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:32 dist-test-slave-njxd krb5kdc[31597](info): set up 2 sockets
Aug 09 08:02:32 dist-test-slave-njxd krb5kdc[31597](info): commencing operation
krb5kdc: starting...
W20260809 08:02:33.063122 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:33 dist-test-slave-njxd krb5kdc[31597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:33.186923 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43613
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:41703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:43613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:33.295428 31610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:33.295724 31610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:33.295797 31610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:33.299832 31610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:33.299911 31610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:33.299947 31610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:33.299998 31610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:33.300034 31610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:33.305071 31610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:41703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:43613
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:33.306131 31610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:33.307114 31610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:33.315356 31618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:33.315363 31615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:33.315369 31616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:33.315413 31610 server_base.cc:1034] running on GCE node
I20260809 08:02:33.316201 31610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:33.317399 31610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:33.318598 31610 hybrid_clock.cc:648] HybridClock initialized: now 1786262553318583 us; error 44 us; skew 500 ppm
Aug 09 08:02:33 dist-test-slave-njxd krb5kdc[31597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262553, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:33.321532 31610 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:33.322468 31610 webserver.cc:460] Webserver started at http://127.8.51.126:40443/ using document root <none> and password file <none>
I20260809 08:02:33.323161 31610 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:33.323275 31610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:33.323513 31610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:33.325551 31610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565"
format_stamp: "Formatted at 2026-08-09 08:02:33 on dist-test-slave-njxd"
server_key: "d8ac4c7eae41f41ca13914b507275dc2"
server_key_iv: "8049abfd3eca4f9f625cfe7588d4daaf"
server_key_version: "encryptionkey@0"
I20260809 08:02:33.326189 31610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565"
format_stamp: "Formatted at 2026-08-09 08:02:33 on dist-test-slave-njxd"
server_key: "d8ac4c7eae41f41ca13914b507275dc2"
server_key_iv: "8049abfd3eca4f9f625cfe7588d4daaf"
server_key_version: "encryptionkey@0"
I20260809 08:02:33.329890 31610 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 08:02:33.332217 31625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:33.333438 31610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:33.333611 31610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565"
format_stamp: "Formatted at 2026-08-09 08:02:33 on dist-test-slave-njxd"
server_key: "d8ac4c7eae41f41ca13914b507275dc2"
server_key_iv: "8049abfd3eca4f9f625cfe7588d4daaf"
server_key_version: "encryptionkey@0"
I20260809 08:02:33.333738 31610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:33.363358 31610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:33.366235 31610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:33.366443 31610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:33.373420 31610 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:43613
I20260809 08:02:33.373452 31679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:43613 every 8 connection(s)
I20260809 08:02:33.374341 31610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:33.376986 31681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:33.382194 31681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: Bootstrap starting.
I20260809 08:02:33.383682 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31610
I20260809 08:02:33.383832 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:33.384083 8397 external_mini_cluster.cc:1428] Setting key f2866654846bde368b133e9f2d0d77e8
I20260809 08:02:33.384616 31681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:33.385525 31681 log.cc:824] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:33.387282 31681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: No bootstrap required, opened a new log
I20260809 08:02:33.390427 31681 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } }
I20260809 08:02:33.390645 31681 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:33.390712 31681 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3ede6a09248bcb6f06b3cc2fbc565, State: Initialized, Role: FOLLOWER
I20260809 08:02:33.391163 31681 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } }
I20260809 08:02:33.391310 31681 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:33.391398 31681 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:33.391538 31681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:33.392647 31681 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } }
I20260809 08:02:33.392927 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:33.385128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55487 (local address 127.8.51.126:43613)
0809 08:02:33.385575 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:33.385645 (+ 70us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:33.385705 (+ 60us) server_negotiation.cc:407] Connection header received
0809 08:02:33.386325 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:33.386340 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:33.386636 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:33.386959 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:33.387347 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:33.388307 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:33.389218 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:33.389751 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:33.389907 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:33.390764 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:33.390770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:33.390809 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:33.391219 (+ 410us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:33.391273 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:33.391319 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:33.391454 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:33.391910 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 08:02:33.392041 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":140,"threads_started":1}
I20260809 08:02:33.392969 31681 leader_election.cc:302] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e3ede6a09248bcb6f06b3cc2fbc565; no voters:
I20260809 08:02:33.393335 31681 leader_election.cc:288] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:33.393440 31686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:33.393726 31686 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [term 1 LEADER]: Becoming Leader. State: Replica: d6e3ede6a09248bcb6f06b3cc2fbc565, State: Running, Role: LEADER
I20260809 08:02:33.394057 31686 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } }
I20260809 08:02:33.394456 31681 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:33.395743 31688 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } } }
I20260809 08:02:33.395915 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:33.396214 31688 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:33.396082 31687 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e3ede6a09248bcb6f06b3cc2fbc565. Latest consensus state: current_term: 1 leader_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e3ede6a09248bcb6f06b3cc2fbc565" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43613 } } }
I20260809 08:02:33.396552 31687 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565 [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:33.399835 31702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:33.399938 31702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:33.399996 31700 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:33.400846 31700 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:33.402212 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:33.398257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45783 (local address 127.8.51.126:43613)
0809 08:02:33.398374 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:33.398379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:33.398526 (+ 147us) server_negotiation.cc:407] Connection header received
0809 08:02:33.398672 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:33.398675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:33.398707 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:33.398800 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:33.399065 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:33.399606 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:33.400527 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:33.400763 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:33.400874 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:33.401737 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:33.401741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:33.401743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:33.401756 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:33.401786 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:33.401797 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:33.401895 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:33.402014 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 08:02:33.402045 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:33.406205 31700 catalog_manager.cc:1347] Generated new cluster ID: bdf4d79fb93946168977fc79b81bd1cd
I20260809 08:02:33.406270 31700 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:33.424700 31700 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:33.425741 31700 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:33.432720 31700 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e3ede6a09248bcb6f06b3cc2fbc565: Generated new TSK 0
I20260809 08:02:33.433393 31700 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:33.441272 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31610
W20260809 08:02:33.448207 31595 connection.cc:535] client connection to 127.8.51.126:43613 recv error: Network error: failed to read from TLS socket (remote: 127.8.51.126:43613): Connection reset by peer (error 104)
2026-08-09T08:02:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1444 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:33 dist-test-slave-njxd krb5kdc[31713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:33 dist-test-slave-njxd krb5kdc[31713](info): set up 2 sockets
Aug 09 08:02:33 dist-test-slave-njxd krb5kdc[31713](info): commencing operation
krb5kdc: starting...
W20260809 08:02:34.482987 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:34 dist-test-slave-njxd krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:34.610119 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41767
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:41767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:34.722558 31727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:34.722837 31727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:34.722924 31727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:34.726926 31727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:34.727001 31727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:34.727046 31727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:34.727103 31727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:34.727139 31727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:34.732789 31727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:41767
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:41767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:34.733846 31727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:34.734863 31727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:34.742938 31732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:34.742946 31735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:34.742998 31727 server_base.cc:1034] running on GCE node
W20260809 08:02:34.742954 31733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:34.743731 31727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:34.744809 31727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:34.745993 31727 hybrid_clock.cc:648] HybridClock initialized: now 1786262554745963 us; error 42 us; skew 500 ppm
Aug 09 08:02:34 dist-test-slave-njxd krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262554, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:34.748957 31727 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:34.749948 31727 webserver.cc:460] Webserver started at http://127.8.51.126:38469/ using document root <none> and password file <none>
I20260809 08:02:34.750506 31727 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:34.750598 31727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:34.750845 31727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:34.752934 31727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "0c460b04099f41e5b28e919e92e3e5b3"
format_stamp: "Formatted at 2026-08-09 08:02:34 on dist-test-slave-njxd"
server_key: "a602f6d271f8120f30c689c08b1d22fc"
server_key_iv: "9f769d36ad7ec3ab4bbe39e9e5ce990e"
server_key_version: "encryptionkey@0"
I20260809 08:02:34.753489 31727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "0c460b04099f41e5b28e919e92e3e5b3"
format_stamp: "Formatted at 2026-08-09 08:02:34 on dist-test-slave-njxd"
server_key: "a602f6d271f8120f30c689c08b1d22fc"
server_key_iv: "9f769d36ad7ec3ab4bbe39e9e5ce990e"
server_key_version: "encryptionkey@0"
I20260809 08:02:34.757112 31727 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:34.759464 31742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:34.760617 31727 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 08:02:34.760762 31727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "0c460b04099f41e5b28e919e92e3e5b3"
format_stamp: "Formatted at 2026-08-09 08:02:34 on dist-test-slave-njxd"
server_key: "a602f6d271f8120f30c689c08b1d22fc"
server_key_iv: "9f769d36ad7ec3ab4bbe39e9e5ce990e"
server_key_version: "encryptionkey@0"
I20260809 08:02:34.760864 31727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:34.765184 31727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:34.768265 31727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:34.768477 31727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:34.775308 31727 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:41767
I20260809 08:02:34.775368 31796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:41767 every 8 connection(s)
I20260809 08:02:34.776222 31727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:34.776885 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31727
I20260809 08:02:34.777027 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:34.777302 8397 external_mini_cluster.cc:1428] Setting key 8c28dcf85bd238251aeca3eaa13708d6
I20260809 08:02:34.779306 31798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:34.782338 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:34.778666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45139 (local address 127.8.51.126:41767)
0809 08:02:34.779090 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:34.779104 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:34.779146 (+ 42us) server_negotiation.cc:407] Connection header received
0809 08:02:34.779793 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:34.779809 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:34.780071 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:34.780423 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:34.781190 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:34.781196 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:34.781215 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:34.781225 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:34.781275 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:34.781294 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:34.781441 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:34.781510 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 08:02:34.781685 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":134,"threads_started":1}
I20260809 08:02:34.784960 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:34.784977 31798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3: Bootstrap starting.
I20260809 08:02:34.787503 31798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:34.788415 31798 log.cc:824] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:34.788635 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:34.786949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60055 (local address 127.8.51.126:41767)
0809 08:02:34.787056 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:34.787059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:34.787266 (+ 207us) server_negotiation.cc:407] Connection header received
0809 08:02:34.787380 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:34.787383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:34.787409 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:34.787471 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:34.788134 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:34.788137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:34.788139 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:34.788149 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:34.788172 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:34.788182 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:34.788247 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:34.788374 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 08:02:34.788403 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 08:02:34.790431 31798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3: No bootstrap required, opened a new log
I20260809 08:02:34.794091 31798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } }
I20260809 08:02:34.794332 31798 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:34.794413 31798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c460b04099f41e5b28e919e92e3e5b3, State: Initialized, Role: FOLLOWER
I20260809 08:02:34.794831 31798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } }
I20260809 08:02:34.794978 31798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:34.795066 31798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:34.795162 31798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:34.796010 31798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } }
I20260809 08:02:34.796345 31798 leader_election.cc:302] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c460b04099f41e5b28e919e92e3e5b3; no voters:
I20260809 08:02:34.796670 31798 leader_election.cc:288] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:34.796777 31809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:34.797021 31809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0c460b04099f41e5b28e919e92e3e5b3, State: Running, Role: LEADER
I20260809 08:02:34.797397 31809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } }
I20260809 08:02:34.797976 31798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:34.799168 31811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c460b04099f41e5b28e919e92e3e5b3. Latest consensus state: current_term: 1 leader_uuid: "0c460b04099f41e5b28e919e92e3e5b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } } }
I20260809 08:02:34.799301 31811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:34.799567 31810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c460b04099f41e5b28e919e92e3e5b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c460b04099f41e5b28e919e92e3e5b3" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 41767 } } }
I20260809 08:02:34.799659 31810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:34.799683 31818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:34.802327 31818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:34.807569 31818 catalog_manager.cc:1347] Generated new cluster ID: 79c3c3afd06c4c1faaa41de429731ea7
I20260809 08:02:34.807631 31818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:34.833707 31818 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:34.834053 31818 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:34.849244 31818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c460b04099f41e5b28e919e92e3e5b3: Generated new TSK 0
I20260809 08:02:34.850028 31818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:34.857273 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31727
2026-08-09T08:02:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:34 dist-test-slave-njxd krb5kdc[31832](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:34 dist-test-slave-njxd krb5kdc[31832](info): set up 2 sockets
Aug 09 08:02:34 dist-test-slave-njxd krb5kdc[31832](info): commencing operation
krb5kdc: starting...
W20260809 08:02:35.935014 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:36.054774 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45511
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:36.162593 31845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:36.162871 31845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:36.162945 31845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:36.166862 31845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:36.166945 31845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:36.166985 31845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:36.167053 31845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:36.167085 31845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:36.172256 31845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:36.173244 31845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:36.174297 31845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:36.182408 31851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:36.182427 31854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:36.182402 31852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:36.182675 31845 server_base.cc:1034] running on GCE node
I20260809 08:02:36.183236 31845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:36.184157 31845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:36.185330 31845 hybrid_clock.cc:648] HybridClock initialized: now 1786262556185303 us; error 37 us; skew 500 ppm
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262556, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:36.193763 31845 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:36.194633 31845 webserver.cc:460] Webserver started at http://127.8.51.126:39325/ using document root <none> and password file <none>
I20260809 08:02:36.195176 31845 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:36.195235 31845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:36.195439 31845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:36.197305 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "f1db4f84c34142e6aadb211354210c39"
format_stamp: "Formatted at 2026-08-09 08:02:36 on dist-test-slave-njxd"
server_key: "2a9414f1fab0b52cab6f4a9a44e42eb2"
server_key_iv: "8ba9e6731dcdbe6524430f80fb95b84d"
server_key_version: "encryptionkey@0"
I20260809 08:02:36.197845 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "f1db4f84c34142e6aadb211354210c39"
format_stamp: "Formatted at 2026-08-09 08:02:36 on dist-test-slave-njxd"
server_key: "2a9414f1fab0b52cab6f4a9a44e42eb2"
server_key_iv: "8ba9e6731dcdbe6524430f80fb95b84d"
server_key_version: "encryptionkey@0"
I20260809 08:02:36.201107 31845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:02:36.203421 31861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:36.204612 31845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:36.204741 31845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "f1db4f84c34142e6aadb211354210c39"
format_stamp: "Formatted at 2026-08-09 08:02:36 on dist-test-slave-njxd"
server_key: "2a9414f1fab0b52cab6f4a9a44e42eb2"
server_key_iv: "8ba9e6731dcdbe6524430f80fb95b84d"
server_key_version: "encryptionkey@0"
I20260809 08:02:36.204842 31845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:36.227970 31845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:36.230922 31845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:36.231151 31845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:36.238399 31845 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45511
I20260809 08:02:36.238415 31914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45511 every 8 connection(s)
I20260809 08:02:36.239323 31845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:36.240636 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31845
I20260809 08:02:36.240769 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:36.241073 8397 external_mini_cluster.cc:1428] Setting key 00be3edbd09a9f06814560b06ece0498
I20260809 08:02:36.242573 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:36.248850 31915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: Bootstrap starting.
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:36.251437 31915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:36.252357 31915 log.cc:824] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:36.254477 31915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: No bootstrap required, opened a new log
I20260809 08:02:36.255636 31918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:36.242491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56843 (local address 127.8.51.126:45511)
0809 08:02:36.242943 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:36.242960 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:36.242995 (+ 35us) server_negotiation.cc:407] Connection header received
0809 08:02:36.243652 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:36.243668 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:36.243987 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:36.244253 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:36.245125 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:36.246115 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:36.247302 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:36.247804 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:36.247909 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:36.250658 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:36.250664 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:36.250679 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:36.250718 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:36.252745 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:36.253309 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:36.253317 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:36.253328 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:36.253436 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:36.253774 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:36.253778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:36.253780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:36.254141 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:36.254344 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:36.254637 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 08:02:36.254966 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":179,"threads_started":1}
I20260809 08:02:36.257485 31915 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } }
I20260809 08:02:36.257817 31915 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:36.257908 31915 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1db4f84c34142e6aadb211354210c39, State: Initialized, Role: FOLLOWER
I20260809 08:02:36.258368 31915 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } }
I20260809 08:02:36.258545 31915 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:36.258621 31915 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:36.258677 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:36.258719 31915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:36.259548 31915 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } }
I20260809 08:02:36.259904 31915 leader_election.cc:302] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1db4f84c34142e6aadb211354210c39; no voters:
I20260809 08:02:36.260212 31915 leader_election.cc:288] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:36.260313 31925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:36.260535 31925 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [term 1 LEADER]: Becoming Leader. State: Replica: f1db4f84c34142e6aadb211354210c39, State: Running, Role: LEADER
I20260809 08:02:36.261015 31925 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } }
I20260809 08:02:36.261534 31915 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:36.262185 31927 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1db4f84c34142e6aadb211354210c39. Latest consensus state: current_term: 1 leader_uuid: "f1db4f84c34142e6aadb211354210c39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } } }
I20260809 08:02:36.262311 31927 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:36.262969 31926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1db4f84c34142e6aadb211354210c39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1db4f84c34142e6aadb211354210c39" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45511 } } }
I20260809 08:02:36.263053 31926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39 [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:36.266954 31941 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:36.267055 31941 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:36.267117 31932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:36.267732 31932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:36.269680 31918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:36.260843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53453 (local address 127.8.51.126:45511)
0809 08:02:36.260942 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:36.260946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:36.261068 (+ 122us) server_negotiation.cc:407] Connection header received
0809 08:02:36.261226 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:36.261229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:36.261290 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:36.261373 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:36.262313 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:36.263159 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:36.264376 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:36.264592 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:36.264671 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:36.266146 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:36.266150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:36.266153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:36.266175 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:36.267792 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:36.268330 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:36.268333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:36.268335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:36.268422 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:36.268743 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:36.268747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:36.268749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:36.268961 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:36.269097 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:36.269385 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 08:02:36.269491 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 08:02:36.273324 31932 catalog_manager.cc:1347] Generated new cluster ID: 4696361bb6bb4ef0bc33fd162793445b
I20260809 08:02:36.273384 31932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:36.288376 31932 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:36.289213 31932 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:36.300853 31932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1db4f84c34142e6aadb211354210c39: Generated new TSK 0
I20260809 08:02:36.301481 31932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:36.313941 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31845
2026-08-09T08:02:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31947](info): set up 2 sockets
Aug 09 08:02:36 dist-test-slave-njxd krb5kdc[31947](info): commencing operation
krb5kdc: starting...
W20260809 08:02:37.379767 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:37 dist-test-slave-njxd krb5kdc[31947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:37.504357 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45385
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:45385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:37.616259 31960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:37.616586 31960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:37.616664 31960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:37.620766 31960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:37.620870 31960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:37.620910 31960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:37.620949 31960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:37.620981 31960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:37.626302 31960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:45385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:45385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:37.627427 31960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:37.628500 31960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:37.637437 31965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:37.637427 31968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:37.637430 31966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:37.637523 31960 server_base.cc:1034] running on GCE node
I20260809 08:02:37.638427 31960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:37.639557 31960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:37.640738 31960 hybrid_clock.cc:648] HybridClock initialized: now 1786262557640725 us; error 27 us; skew 500 ppm
Aug 09 08:02:37 dist-test-slave-njxd krb5kdc[31947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262557, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:37.643599 31960 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:37.644554 31960 webserver.cc:460] Webserver started at http://127.8.51.126:37935/ using document root <none> and password file <none>
I20260809 08:02:37.645129 31960 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:37.645221 31960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:37.645463 31960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:37.647737 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "b30fc89674af49589ca76a5274bdd38c"
format_stamp: "Formatted at 2026-08-09 08:02:37 on dist-test-slave-njxd"
server_key: "7c0d05905109432ac5a95ae748ecf865"
server_key_iv: "189fbf8139ee1be778974bf0de2042fe"
server_key_version: "encryptionkey@0"
I20260809 08:02:37.648326 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "b30fc89674af49589ca76a5274bdd38c"
format_stamp: "Formatted at 2026-08-09 08:02:37 on dist-test-slave-njxd"
server_key: "7c0d05905109432ac5a95ae748ecf865"
server_key_iv: "189fbf8139ee1be778974bf0de2042fe"
server_key_version: "encryptionkey@0"
I20260809 08:02:37.652192 31960 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 08:02:37.654759 31975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:37.656009 31960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 08:02:37.656168 31960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "b30fc89674af49589ca76a5274bdd38c"
format_stamp: "Formatted at 2026-08-09 08:02:37 on dist-test-slave-njxd"
server_key: "7c0d05905109432ac5a95ae748ecf865"
server_key_iv: "189fbf8139ee1be778974bf0de2042fe"
server_key_version: "encryptionkey@0"
I20260809 08:02:37.656286 31960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:37.668874 31960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:37.671993 31960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:37.672215 31960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:37.679755 31960 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:45385
I20260809 08:02:37.679771 32031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:45385 every 8 connection(s)
I20260809 08:02:37.680761 31960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:37.681252 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 31960
I20260809 08:02:37.681406 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:37.681775 8397 external_mini_cluster.cc:1428] Setting key 56272fba7b236900ef8370cd62c6d24f
I20260809 08:02:37.684002 32032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:37.689651 32032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: Bootstrap starting.
I20260809 08:02:37.690634 32035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:37.683216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44801 (local address 127.8.51.126:45385)
0809 08:02:37.683647 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:37.683663 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:37.683708 (+ 45us) server_negotiation.cc:407] Connection header received
0809 08:02:37.684426 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:37.684446 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:37.684810 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:37.685139 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:37.685544 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:37.686585 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:37.687524 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:37.687995 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:37.688161 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:37.689051 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:37.689055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:37.689068 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:37.689434 (+ 366us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:37.689484 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:37.689504 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:37.689627 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:37.689782 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 08:02:37.689980 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":139,"threads_started":1}
I20260809 08:02:37.692097 32032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:37.693003 32032 log.cc:824] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:37.693311 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:37.695082 32032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: No bootstrap required, opened a new log
I20260809 08:02:37.698598 32032 raft_consensus.cc:348] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } }
I20260809 08:02:37.698830 32032 raft_consensus.cc:374] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:37.698923 32032 raft_consensus.cc:729] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30fc89674af49589ca76a5274bdd38c, State: Initialized, Role: FOLLOWER
I20260809 08:02:37.698957 32035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:37.695360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41649 (local address 127.8.51.126:45385)
0809 08:02:37.695465 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:37.695469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:37.695644 (+ 175us) server_negotiation.cc:407] Connection header received
0809 08:02:37.695799 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:37.695802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:37.695845 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:37.695922 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:37.696163 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:37.696634 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:37.697418 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:37.697718 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:37.697821 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:37.698530 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:37.698533 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:37.698535 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:37.698546 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:37.698575 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:37.698585 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:37.698657 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:37.698742 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 08:02:37.698786 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 08:02:37.699393 32032 consensus_queue.cc:260] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } }
I20260809 08:02:37.699517 32032 raft_consensus.cc:388] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:37.699599 32032 raft_consensus.cc:482] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:37.699689 32032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:37.700471 32032 raft_consensus.cc:504] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } }
I20260809 08:02:37.700776 32032 leader_election.cc:302] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b30fc89674af49589ca76a5274bdd38c; no voters:
I20260809 08:02:37.701120 32032 leader_election.cc:288] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:37.701193 32043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:37.701447 32043 raft_consensus.cc:686] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [term 1 LEADER]: Becoming Leader. State: Replica: b30fc89674af49589ca76a5274bdd38c, State: Running, Role: LEADER
I20260809 08:02:37.701815 32043 consensus_queue.cc:237] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } }
I20260809 08:02:37.702437 32032 sys_catalog.cc:564] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:37.702960 32043 sys_catalog.cc:455] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b30fc89674af49589ca76a5274bdd38c. Latest consensus state: current_term: 1 leader_uuid: "b30fc89674af49589ca76a5274bdd38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } } }
I20260809 08:02:37.703078 32043 sys_catalog.cc:458] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:37.703328 32043 sys_catalog.cc:455] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b30fc89674af49589ca76a5274bdd38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b30fc89674af49589ca76a5274bdd38c" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 45385 } } }
I20260809 08:02:37.703459 32043 sys_catalog.cc:458] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:37.706857 32059 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:37.706943 32059 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:37.707013 32049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:37.707659 32049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:37.713140 32049 catalog_manager.cc:1347] Generated new cluster ID: fc5cba73eea243f3be0227d37a361629
I20260809 08:02:37.713197 32049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:37.736776 32049 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:37.738121 32049 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:37.750164 32049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b30fc89674af49589ca76a5274bdd38c: Generated new TSK 0
I20260809 08:02:37.750898 32049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:37.762466 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 31960
2026-08-09T08:02:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:37 dist-test-slave-njxd krb5kdc[32064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:37 dist-test-slave-njxd krb5kdc[32064](info): set up 2 sockets
Aug 09 08:02:37 dist-test-slave-njxd krb5kdc[32064](info): commencing operation
krb5kdc: starting...
W20260809 08:02:38.815157 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:38 dist-test-slave-njxd krb5kdc[32064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:38.934456 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36341
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:46559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:36341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:39.043052 32077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:39.043365 32077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:39.043442 32077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:39.047447 32077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:39.047540 32077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:39.047590 32077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:39.047665 32077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:39.047701 32077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:39.052843 32077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:46559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:36341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:36341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:39.053949 32077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:39.054991 32077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:39.063508 32077 server_base.cc:1034] running on GCE node
W20260809 08:02:39.063472 32082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:39.063460 32085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:39.063535 32083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:39.064236 32077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:39.065351 32077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:39.066538 32077 hybrid_clock.cc:648] HybridClock initialized: now 1786262559066510 us; error 40 us; skew 500 ppm
Aug 09 08:02:39 dist-test-slave-njxd krb5kdc[32064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262559, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:39.069245 32077 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:39.070447 32077 webserver.cc:460] Webserver started at http://127.8.51.126:36915/ using document root <none> and password file <none>
I20260809 08:02:39.071174 32077 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:39.071281 32077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:39.071540 32077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:39.074649 32077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "e0f989d41ea4461e89abebb56a06de79"
format_stamp: "Formatted at 2026-08-09 08:02:39 on dist-test-slave-njxd"
server_key: "c0dec198b246d012699661b294e7c1bb"
server_key_iv: "212cfeff0d282be280bb1f4990e7d5ce"
server_key_version: "encryptionkey@0"
I20260809 08:02:39.075345 32077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "e0f989d41ea4461e89abebb56a06de79"
format_stamp: "Formatted at 2026-08-09 08:02:39 on dist-test-slave-njxd"
server_key: "c0dec198b246d012699661b294e7c1bb"
server_key_iv: "212cfeff0d282be280bb1f4990e7d5ce"
server_key_version: "encryptionkey@0"
I20260809 08:02:39.079627 32077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 08:02:39.081997 32092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:39.083292 32077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:39.083431 32077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "e0f989d41ea4461e89abebb56a06de79"
format_stamp: "Formatted at 2026-08-09 08:02:39 on dist-test-slave-njxd"
server_key: "c0dec198b246d012699661b294e7c1bb"
server_key_iv: "212cfeff0d282be280bb1f4990e7d5ce"
server_key_version: "encryptionkey@0"
I20260809 08:02:39.083545 32077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:39.088105 32077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:39.090993 32077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:39.091195 32077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:39.098341 32077 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:36341
I20260809 08:02:39.098371 32146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:36341 every 8 connection(s)
I20260809 08:02:39.099244 32077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:39.101022 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32077
I20260809 08:02:39.101155 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:39.101428 8397 external_mini_cluster.cc:1428] Setting key eaf4ebb2986cfa3843bc4b98becdeb91
I20260809 08:02:39.102124 32147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:39.106585 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:39.102781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55023 (local address 127.8.51.126:36341)
0809 08:02:39.103191 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:39.103207 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:39.103241 (+ 34us) server_negotiation.cc:407] Connection header received
0809 08:02:39.103862 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:39.103877 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:39.104142 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:39.104420 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:39.105336 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:39.105341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:39.105352 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:39.105362 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:39.105413 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:39.105431 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:39.105539 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:39.105715 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 08:02:39.105882 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":144,"threads_started":1}
I20260809 08:02:39.108493 32147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79: Bootstrap starting.
I20260809 08:02:39.109287 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:39.111148 32147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:39.112073 32147 log.cc:824] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:39.113411 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:39.111633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57251 (local address 127.8.51.126:36341)
0809 08:02:39.111771 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:39.111776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:39.111983 (+ 207us) server_negotiation.cc:407] Connection header received
0809 08:02:39.112105 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:39.112107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:39.112135 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:39.112228 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:39.113019 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:39.113022 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:39.113023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 08:02:39.113033 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:39.113056 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 08:02:39.113065 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:39.113133 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:39.113249 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 08:02:39.113278 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 08:02:39.114392 32147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79: No bootstrap required, opened a new log
I20260809 08:02:39.118045 32147 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } }
I20260809 08:02:39.118281 32147 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 08:02:39.118340 32147 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f989d41ea4461e89abebb56a06de79, State: Initialized, Role: FOLLOWER
I20260809 08:02:39.118840 32147 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } }
I20260809 08:02:39.119004 32147 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 08:02:39.119069 32147 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 08:02:39.119168 32147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:39.120102 32147 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } }
I20260809 08:02:39.120443 32147 leader_election.cc:302] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0f989d41ea4461e89abebb56a06de79; no voters:
I20260809 08:02:39.120764 32147 leader_election.cc:288] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 08:02:39.120919 32157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:39.121151 32157 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [term 1 LEADER]: Becoming Leader. State: Replica: e0f989d41ea4461e89abebb56a06de79, State: Running, Role: LEADER
I20260809 08:02:39.121490 32157 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } }
I20260809 08:02:39.122041 32147 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:39.123267 32159 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0f989d41ea4461e89abebb56a06de79. Latest consensus state: current_term: 1 leader_uuid: "e0f989d41ea4461e89abebb56a06de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } } }
I20260809 08:02:39.123404 32159 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:39.123260 32158 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0f989d41ea4461e89abebb56a06de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f989d41ea4461e89abebb56a06de79" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 36341 } } }
I20260809 08:02:39.123482 32158 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:39.123852 32167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:39.127025 32167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:39.133608 32167 catalog_manager.cc:1347] Generated new cluster ID: 7b255fc73f3e470aab9673db8f12bb28
I20260809 08:02:39.133678 32167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:39.146258 32167 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:39.146574 32167 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:39.157188 32167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0f989d41ea4461e89abebb56a06de79: Generated new TSK 0
I20260809 08:02:39.157974 32167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 08:02:39.165192 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32077
2026-08-09T08:02:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1403 ms)
[----------] 18 tests from AuthTokenIssuingTest (25672 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:39 dist-test-slave-njxd krb5kdc[32180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:39 dist-test-slave-njxd krb5kdc[32180](info): set up 2 sockets
Aug 09 08:02:39 dist-test-slave-njxd krb5kdc[32180](info): commencing operation
krb5kdc: starting...
W20260809 08:02:40.223095 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:40.352859 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33355
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:40.465418 32194 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:40.465792 32194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:40.465868 32194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:40.465953 32194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:40.470108 32194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:40.470194 32194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:40.470234 32194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:40.470273 32194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:40.470306 32194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:40.475754 32194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:33355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:40.476905 32194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:40.478060 32194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:40.486744 32202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:40.486815 32200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:40.486799 32199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:40.487032 32194 server_base.cc:1034] running on GCE node
I20260809 08:02:40.487727 32194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:40.488852 32194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:40.490041 32194 hybrid_clock.cc:648] HybridClock initialized: now 1786262560490027 us; error 30 us; skew 500 ppm
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:40.492751 32194 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:40.493690 32194 webserver.cc:460] Webserver started at http://127.8.51.126:39159/ using document root <none> and password file <none>
I20260809 08:02:40.494266 32194 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:40.494359 32194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:40.494620 32194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:40.496685 32194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "3da261a6bb5340fc89b8d3dcb040fdda"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "601ea0734b826a6ff53c6c8a2b8c2f88"
server_key_iv: "c8b9d31c25584829ad832772077617c0"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.497262 32194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "3da261a6bb5340fc89b8d3dcb040fdda"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "601ea0734b826a6ff53c6c8a2b8c2f88"
server_key_iv: "c8b9d31c25584829ad832772077617c0"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.501451 32194 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 08:02:40.503916 32209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:40.505108 32194 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:40.505265 32194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "3da261a6bb5340fc89b8d3dcb040fdda"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "601ea0734b826a6ff53c6c8a2b8c2f88"
server_key_iv: "c8b9d31c25584829ad832772077617c0"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.505381 32194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:40.519753 32194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:40.522565 32194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:40.522778 32194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:40.530084 32194 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:33355
I20260809 08:02:40.530380 32261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:33355 every 8 connection(s)
I20260809 08:02:40.531056 32194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:40.533911 32262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:40.537701 32262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:40.539774 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32194
I20260809 08:02:40.539917 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:40.540248 8397 external_mini_cluster.cc:1428] Setting key 4a348a5961a84045df1646a001a605a2
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.125@KRBTEST.COM" created.
I20260809 08:02:40.553521 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.539956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33355 (local address 127.0.0.1:48112)
0809 08:02:40.540577 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.540636 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.541963 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.542697 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.542702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.543158 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.543402 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.543414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.544564 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.544567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.545300 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.545309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.546013 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.546017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.546129 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.546740 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.546757 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.548557 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.550739 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.550748 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.550756 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.550977 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.551275 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.551277 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.551279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.551386 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.552088 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.552093 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.552213 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.552398 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.552817 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":63,"spinlock_wait_cycles":40192,"thread_start_us":155,"threads_started":1}
I20260809 08:02:40.553524 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.539956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48112 (local address 127.8.51.126:33355)
0809 08:02:40.540514 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.540531 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.540762 (+ 231us) server_negotiation.cc:407] Connection header received
0809 08:02:40.542300 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.542305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.542482 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.542695 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.543552 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.544430 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.545420 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.545859 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.546029 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.548717 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.548722 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.548732 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.548753 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.550638 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.551077 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.551081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.551083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.551193 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.551467 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.551469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.551470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.551982 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.552090 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.552501 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.552683 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":157,"threads_started":1}
I20260809 08:02:40.556092 32262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:40.556895 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.556551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48924)
0809 08:02:40.556700 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.556802 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 08:02:40.557112 32210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
I20260809 08:02:40.558007 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.557735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48940)
0809 08:02:40.557870 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.557931 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 08:02:40.558205 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:42815: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
I20260809 08:02:40.568912 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:42815
--webserver_interface=127.8.51.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:02:40.607482 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } attempt: 1
I20260809 08:02:40.608418 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.608056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48942)
0809 08:02:40.608246 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.608324 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 08:02:40.609231 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.608946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48944)
0809 08:02:40.609078 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.609139 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 08:02:40.609391 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:42815: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
I20260809 08:02:40.677608 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } attempt: 2
I20260809 08:02:40.678504 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.678153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48950)
0809 08:02:40.678340 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.678412 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 08:02:40.679241 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.679019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48960)
0809 08:02:40.679130 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.679180 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 08:02:40.679371 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:42815: Network error: Client connection negotiation failed: client connection to 127.8.51.125:42815: connect: Connection refused (error 111)
W20260809 08:02:40.680801 32269 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:40.681051 32269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:40.681106 32269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:40.681169 32269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:40.685132 32269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:40.685176 32269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:40.685194 32269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:40.685231 32269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:40.685264 32269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:40.690407 32269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:42815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.51.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:40.691399 32269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:40.692377 32269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:40.700649 32274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:40.700819 32277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:40.700712 32269 server_base.cc:1034] running on GCE node
W20260809 08:02:40.700687 32275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:40.701382 32269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:40.702471 32269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:40.703644 32269 hybrid_clock.cc:648] HybridClock initialized: now 1786262560703631 us; error 23 us; skew 500 ppm
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:40.706348 32269 init.cc:377] Logged in from keytab as kudu/127.8.51.125@KRBTEST.COM (short username kudu)
I20260809 08:02:40.707156 32269 webserver.cc:460] Webserver started at http://127.8.51.125:34077/ using document root <none> and password file <none>
I20260809 08:02:40.707679 32269 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:40.707739 32269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:40.707967 32269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:40.710120 32269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data/instance:
uuid: "91423f4f926a4ce486eee953bc1e1884"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "29e7674dc58e494f62069fcdfa0cc8a6"
server_key_iv: "98a3c168255d1d724185ff5f88df9ba1"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.710660 32269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal/instance:
uuid: "91423f4f926a4ce486eee953bc1e1884"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "29e7674dc58e494f62069fcdfa0cc8a6"
server_key_iv: "98a3c168255d1d724185ff5f88df9ba1"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.714154 32269 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 08:02:40.716393 32286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:40.717676 32269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 08:02:40.717801 32269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "91423f4f926a4ce486eee953bc1e1884"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "29e7674dc58e494f62069fcdfa0cc8a6"
server_key_iv: "98a3c168255d1d724185ff5f88df9ba1"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.717903 32269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:40.739773 32269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:40.743037 32269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:40.743229 32269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:40.749756 32269 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.125:42815
I20260809 08:02:40.750032 32339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.125:42815 every 8 connection(s)
I20260809 08:02:40.750711 32269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
I20260809 08:02:40.753275 32340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:40.755731 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32269
I20260809 08:02:40.755867 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-1/wal/instance
I20260809 08:02:40.756170 8397 external_mini_cluster.cc:1428] Setting key 03cd4d67efa46365482cb5e7d026e28c
I20260809 08:02:40.757376 32340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.51.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.124@KRBTEST.COM" created.
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:40.770520 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } attempt: 3
I20260809 08:02:40.772523 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.759412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48122 (local address 127.8.51.126:33355)
0809 08:02:40.759575 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.759580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.760397 (+ 817us) server_negotiation.cc:407] Connection header received
0809 08:02:40.761278 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.761282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.761338 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.761444 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.762562 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.763104 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.764200 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.764433 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.764548 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.768462 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.768465 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.768467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.768491 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.770127 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.770719 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.770723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.770725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.770820 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.771238 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.771245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.771249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.771476 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.771537 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.772216 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.772327 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 08:02:40.773820 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.759787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33355 (local address 127.0.0.1:48122)
0809 08:02:40.760215 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.760266 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.761078 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.761624 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.761630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.761973 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.762414 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.762426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.763240 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.763250 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.764066 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.764075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.764579 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.764583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.764795 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.765297 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.765313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.768290 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.770262 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.770268 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.770282 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.770582 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.770945 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.770948 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.770950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.771115 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.771606 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.771611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.771914 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.772757 (+ 843us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.773035 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":131,"threads_started":1}
I20260809 08:02:40.775569 32340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:40.783715 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.770996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48976)
0809 08:02:40.771207 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.771225 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.771307 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.772059 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.772065 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.772260 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.772350 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.772357 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.773965 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.773968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.774907 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.774920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.775821 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.775825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.775952 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.776432 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.776450 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.779994 (+ 3544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.782039 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.782043 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.782045 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.782341 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.782641 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.782644 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.782646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.782746 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.783328 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.783331 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.783415 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.783500 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.783598 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260809 08:02:40.783933 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.771112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.8.51.125:42815)
0809 08:02:40.771587 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.771602 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.771631 (+ 29us) server_negotiation.cc:407] Connection header received
0809 08:02:40.771680 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.771689 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.771911 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.772064 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.772477 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.773809 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.775072 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.775685 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.775825 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.780164 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.780175 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.780195 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.780226 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.781930 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.782459 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.782463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.782464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.782540 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.782871 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.782873 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.782874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.783197 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.783351 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.783624 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.783757 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":137,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
I20260809 08:02:40.785511 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:45271
--webserver_interface=127.8.51.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:02:40.785641 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.776062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48990)
0809 08:02:40.776190 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.776204 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.776279 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.776680 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.776691 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.776853 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.776926 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.776930 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.777692 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.777696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.778216 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.778223 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.778722 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.778725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.778835 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.779344 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.779364 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.780847 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.783909 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.783914 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.783915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.784234 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.784511 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.784515 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.784520 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.784667 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.785094 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.785097 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.785186 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.785301 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.785441 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":4}
I20260809 08:02:40.785777 32262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:40.786551 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.786235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44084)
0809 08:02:40.786410 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.786467 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 08:02:40.787287 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.786961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44088)
0809 08:02:40.787160 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.787211 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260809 08:02:40.787290 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.776217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48990 (local address 127.8.51.125:42815)
0809 08:02:40.776497 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.776506 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.776517 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:02:40.776543 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.776545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.776573 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.776672 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.777030 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.777526 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.778326 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.778617 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.778722 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.781207 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.781210 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.781212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.781233 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.783689 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.784322 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.784325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.784327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.784408 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.784767 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.784770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.784772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.784961 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.785066 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.785364 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.785510 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":227,"thread_start_us":127,"threads_started":1}
W20260809 08:02:40.787551 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
I20260809 08:02:40.787958 32340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:40.788642 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.788387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44104)
0809 08:02:40.788522 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.788596 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 08:02:40.788822 32288 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
I20260809 08:02:40.789701 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.789444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44120)
0809 08:02:40.789540 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.789636 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 08:02:40.789929 32340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
I20260809 08:02:40.818742 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 1
I20260809 08:02:40.819563 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.819269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44122)
0809 08:02:40.819427 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.819490 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 08:02:40.820307 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.820087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44132)
0809 08:02:40.820196 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.820242 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 08:02:40.820446 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
I20260809 08:02:40.839162 32340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 1
I20260809 08:02:40.839967 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.839720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44138)
0809 08:02:40.839847 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.839903 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 08:02:40.840711 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.840478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44152)
0809 08:02:40.840599 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.840658 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 08:02:40.840893 32340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
I20260809 08:02:40.895588 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 2
I20260809 08:02:40.896337 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.896064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44154)
0809 08:02:40.896197 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.896264 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 08:02:40.896591 32347 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:40.896915 32347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:40.896977 32347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:40.897028 32347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 08:02:40.897162 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.896914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44166)
0809 08:02:40.897041 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.897099 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 08:02:40.897318 32262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
W20260809 08:02:40.900817 32347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:40.900889 32347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:40.900925 32347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:40.900956 32347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:40.900988 32347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:40.905910 32347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:33355,127.8.51.125:42815,127.8.51.124:45271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:45271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.51.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:40.906798 32347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:40.907773 32347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 08:02:40.909044 32340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 2
I20260809 08:02:40.909746 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.909478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44176)
0809 08:02:40.909640 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.909690 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 08:02:40.910437 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.910219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44190)
0809 08:02:40.910336 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.910392 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 08:02:40.910552 32340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:45271: Network error: Client connection negotiation failed: client connection to 127.8.51.124:45271: connect: Connection refused (error 111)
W20260809 08:02:40.916255 32354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:40.916275 32355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:40.916291 32357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:40.916478 32347 server_base.cc:1034] running on GCE node
I20260809 08:02:40.917021 32347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:40.918099 32347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:40.919298 32347 hybrid_clock.cc:648] HybridClock initialized: now 1786262560919264 us; error 43 us; skew 500 ppm
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:40.922274 32347 init.cc:377] Logged in from keytab as kudu/127.8.51.124@KRBTEST.COM (short username kudu)
I20260809 08:02:40.923141 32347 webserver.cc:460] Webserver started at http://127.8.51.124:35823/ using document root <none> and password file <none>
I20260809 08:02:40.923633 32347 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:40.923692 32347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:40.923846 32347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:40.925932 32347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data/instance:
uuid: "b2e77315de8d47249d9ad5a310537917"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "07e22234acd15513ca37bc213355ca99"
server_key_iv: "06e470bff0558e6268b11554607e7243"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.926453 32347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal/instance:
uuid: "b2e77315de8d47249d9ad5a310537917"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "07e22234acd15513ca37bc213355ca99"
server_key_iv: "06e470bff0558e6268b11554607e7243"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.929895 32347 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 08:02:40.932082 32364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:40.933223 32347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:40.933338 32347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "b2e77315de8d47249d9ad5a310537917"
format_stamp: "Formatted at 2026-08-09 08:02:40 on dist-test-slave-njxd"
server_key: "07e22234acd15513ca37bc213355ca99"
server_key_iv: "06e470bff0558e6268b11554607e7243"
server_key_version: "encryptionkey@0"
I20260809 08:02:40.933452 32347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:40.951324 32347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:40.954043 32347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:40.954243 32347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:40.960680 32347 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.124:45271
I20260809 08:02:40.960944 32419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.124:45271 every 8 connection(s)
I20260809 08:02:40.961529 32347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
I20260809 08:02:40.962615 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32347
I20260809 08:02:40.962711 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786262281998942-8397-0/minicluster-data/master-2/wal/instance
I20260809 08:02:40.962987 8397 external_mini_cluster.cc:1428] Setting key 2dc8081e86fb7f39e01d960b197fe0b3
I20260809 08:02:40.964584 32420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:40.968057 32420 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:40.976927 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.964495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.8.51.124:45271)
0809 08:02:40.964872 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.964885 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.964922 (+ 37us) server_negotiation.cc:407] Connection header received
0809 08:02:40.965540 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.965554 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.965935 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.966248 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.967035 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.967991 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.968893 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.969469 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.969655 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.972290 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.972295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.972303 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.972327 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.974171 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.974570 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.974576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.974582 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.974740 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.974993 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.974996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.974997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.975360 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.975552 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.975858 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.976155 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":126,"threads_started":1}
I20260809 08:02:40.978519 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.969669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:33355 (local address 127.0.0.1:48130)
0809 08:02:40.970015 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.970071 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.970183 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.970530 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.970534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.970838 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.970952 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.970957 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.971769 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.971773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.972554 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.972564 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.973092 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.973095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.973213 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.973621 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.973644 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.975103 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.976875 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.976885 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.976890 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.977208 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.977486 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.977490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.977493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.977616 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.978053 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.978057 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.978165 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.978268 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.978387 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":121,"threads_started":1}
I20260809 08:02:40.978636 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.969749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48130 (local address 127.8.51.126:33355)
0809 08:02:40.969887 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.969893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.970162 (+ 269us) server_negotiation.cc:407] Connection header received
0809 08:02:40.970321 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.970325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.970387 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.970484 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.971084 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.971608 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.972671 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.972958 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.973091 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.975271 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.975274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.975276 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.975298 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.976767 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.977314 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.977318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.977319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.977397 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.977702 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.977705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.977707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.977943 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.978045 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.978363 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.978474 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 08:02:40.979561 32420 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:40.987646 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.979996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:42815 (local address 127.0.0.1:48996)
0809 08:02:40.980100 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.980114 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.980188 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.980536 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.980539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.980699 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.980778 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.980783 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.981482 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.981488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.982085 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.982093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.982556 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.982559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.982653 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.983083 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.983094 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.984604 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.986230 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986232 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.986233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.986404 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.986710 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986712 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.986713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.986782 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.987151 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.987154 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.987237 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.987346 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.987490 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 08:02:40.987709 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.980192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.8.51.125:42815)
0809 08:02:40.980352 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.980355 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.980367 (+ 12us) server_negotiation.cc:407] Connection header received
0809 08:02:40.980401 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.980403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.980440 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.980524 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.980892 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.981381 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.982211 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.982450 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.982556 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.984757 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.984759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.984761 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.984783 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.986130 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986521 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.986523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.986525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.986614 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986897 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.986899 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.986900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.987053 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.987147 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.987414 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.987525 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 08:02:40.987679 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.979386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48136 (local address 127.8.51.126:33355)
0809 08:02:40.979490 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.979493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.979506 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:40.979642 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.979645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.979696 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.979767 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.980453 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.980907 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.981703 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.981940 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.982050 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.984433 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.984436 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.984439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.984467 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.986041 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986483 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.986489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.986494 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.986572 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.986868 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.986871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.986873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.987057 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.987288 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.987445 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.987541 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 08:02:40.988487 32420 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
Aug 09 08:02:40 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:40.996476 32262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 3
I20260809 08:02:40.996675 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.988952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44210)
0809 08:02:40.989031 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.989041 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.989131 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.989485 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.989488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.989715 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.989811 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.989821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.990630 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.990632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.991217 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.991227 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.991656 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.991660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:40.991738 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.992242 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:40.992261 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:40.993403 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:40.995101 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.995106 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.995110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.995369 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.995688 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:40.995692 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:40.995694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:40.995789 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:40.996134 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:40.996139 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:40.996247 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 08:02:40.996355 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 08:02:40.996526 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 08:02:40.996824 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.989086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.8.51.124:45271)
0809 08:02:40.989190 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.989194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.989206 (+ 12us) server_negotiation.cc:407] Connection header received
0809 08:02:40.989259 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.989264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.989307 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.989384 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.989932 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.990516 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.991333 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.991549 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.991624 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.993545 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.993548 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.993550 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.993567 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.994997 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.995486 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.995490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.995493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.995584 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.995882 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.995884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.995885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.996039 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.996123 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.996430 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.996613 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":32}
I20260809 08:02:40.998383 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.989320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49006 (local address 127.8.51.125:42815)
0809 08:02:40.989445 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.989448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.989459 (+ 11us) server_negotiation.cc:407] Connection header received
0809 08:02:40.989561 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.989563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.989634 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.989710 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.990361 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.990929 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.991841 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:40.992038 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:40.992147 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:40.994546 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:40.994549 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:40.994551 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:40.994573 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:40.996210 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.996711 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.996714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.996716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.996798 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:40.997262 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:40.997267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:40.997268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:40.997491 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:40.997746 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:40.998082 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 08:02:40.998203 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 08:02:41.000366 32420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: Bootstrap starting.
I20260809 08:02:41.001694 32340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } attempt: 3
I20260809 08:02:41.002702 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 08:02:41.003212 32420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:41.004609 32420 log.cc:824] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:41.004202 32236 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3da261a6bb5340fc89b8d3dcb040fdda"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48136
Aug 09 08:02:41 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:02:41.007010 32420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: No bootstrap required, opened a new log
Aug 09 08:02:41 dist-test-slave-njxd krb5kdc[32180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262560, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:02:41.009819 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.996893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44224)
0809 08:02:40.997176 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:40.997191 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:40.997278 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:40.997562 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:40.997565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:40.997774 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:40.997877 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:40.997885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.002564 (+ 4679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.002568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:41.003391 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:41.003402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.004027 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.004031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:41.004110 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.004575 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:41.004589 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:41.006043 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:41.008144 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:41.008149 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:41.008153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:41.008415 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:41.008672 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:41.008676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:41.008678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:41.008781 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:41.009247 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:41.009250 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:41.009351 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 08:02:41.009476 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 08:02:41.009662 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260809 08:02:41.009819 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:40.997162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44224 (local address 127.8.51.124:45271)
0809 08:02:40.997269 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:40.997274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:40.997286 (+ 12us) server_negotiation.cc:407] Connection header received
0809 08:02:40.997375 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:40.997377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:40.997414 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:40.997991 (+ 577us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:40.998073 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.002447 (+ 4374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.003510 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.003820 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.003922 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.006179 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:41.006182 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:41.006185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:41.006205 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:41.007988 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.008495 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.008499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.008501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.008580 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.008885 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.008890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.008893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.009121 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:41.009258 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:41.009527 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 08:02:41.009662 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 08:02:41.011427 32420 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.011686 32420 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e77315de8d47249d9ad5a310537917, State: Initialized, Role: FOLLOWER
I20260809 08:02:41.012066 32420 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.012290 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:41.002023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:45271 (local address 127.0.0.1:44240)
0809 08:02:41.002176 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:41.002200 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:41.002266 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:41.003017 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:41.003020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:41.003192 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:41.003280 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:41.003286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.004333 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.004336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:41.005124 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:41.005134 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.005802 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.005806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:41.005890 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.006331 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:41.006347 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:41.007809 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:41.010739 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:41.010745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:41.010747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:41.010974 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:41.011277 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:41.011280 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:41.011281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:41.011368 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:41.011797 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:41.011800 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:41.011910 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 08:02:41.011989 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 08:02:41.012130 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 08:02:41.012821 32262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: Bootstrap starting.
I20260809 08:02:41.012897 32425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:41.002466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44240 (local address 127.8.51.124:45271)
0809 08:02:41.002788 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.002796 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.002809 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:41.002841 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.002844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.002882 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.003386 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.003487 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.004199 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.005277 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.005664 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.006093 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.007959 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:41.007963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:41.007966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:41.007985 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:41.010632 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.011080 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.011083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.011085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.011176 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.011463 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.011466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.011468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.011670 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:41.012561 (+ 891us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:41.012633 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 08:02:41.012736 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":140,"threads_started":1}
I20260809 08:02:41.013468 32420 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:41.013410 32428 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.013532 32428 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.015512 32262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:41.015667 32340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: Bootstrap starting.
I20260809 08:02:41.018072 32340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: Neither blocks nor log segments found. Creating new log.
W20260809 08:02:41.018617 32439 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:41.018677 32439 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:41.018815 32340 log.cc:824] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:41.017423 32347 master_runner.cc:186] Error getting master registration for 127.8.51.126:33355: OK, instance_id { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" instance_seqno: 1786262560527909 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:02:41.020756 32347 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:02:41.020861 32262 log.cc:824] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:41.021178 32340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: No bootstrap required, opened a new log
I20260809 08:02:41.024045 32340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.024269 32340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91423f4f926a4ce486eee953bc1e1884, State: Initialized, Role: FOLLOWER
I20260809 08:02:41.024698 32340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.025283 32443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.025533 32443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.025928 32340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:41.029844 32262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: No bootstrap required, opened a new log
W20260809 08:02:41.030998 32454 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:41.031117 32454 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:41.029451 32269 master_runner.cc:186] Error getting master registration for 127.8.51.126:33355: OK, instance_id { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" instance_seqno: 1786262560527909 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:02:41.032876 32269 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:02:41.032970 32262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.033226 32262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3da261a6bb5340fc89b8d3dcb040fdda, State: Initialized, Role: FOLLOWER
I20260809 08:02:41.033546 32262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.034137 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.034376 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.034920 32262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:41.035010 32236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 08:02:41.035121 32236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:41.036415 32236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.038170 32313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "91423f4f926a4ce486eee953bc1e1884"
I20260809 08:02:41.038177 32394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b2e77315de8d47249d9ad5a310537917"
I20260809 08:02:41.038383 32313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:41.038422 32394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:41.039573 32313 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3da261a6bb5340fc89b8d3dcb040fdda in term 1.
I20260809 08:02:41.039794 32394 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3da261a6bb5340fc89b8d3dcb040fdda in term 1.
I20260809 08:02:41.040993 32211 leader_election.cc:302] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3da261a6bb5340fc89b8d3dcb040fdda, b2e77315de8d47249d9ad5a310537917; no voters:
I20260809 08:02:41.041270 32456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:41.041519 32456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [term 1 LEADER]: Becoming Leader. State: Replica: 3da261a6bb5340fc89b8d3dcb040fdda, State: Running, Role: LEADER
I20260809 08:02:41.041939 32456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } }
I20260809 08:02:41.037312 32236 leader_election.cc:288] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [CANDIDATE]: Term 1 election: Requested vote from peers 91423f4f926a4ce486eee953bc1e1884 (127.8.51.125:42815), b2e77315de8d47249d9ad5a310537917 (127.8.51.124:45271)
I20260809 08:02:41.047830 32194 master_runner.cc:263] No leader master found from master 3da261a6bb5340fc89b8d3dcb040fdda
I20260809 08:02:41.047896 32194 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:02:41.048993 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3da261a6bb5340fc89b8d3dcb040fdda. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.049201 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: This master's current role is: LEADER
W20260809 08:02:41.041049 32467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:41.053637 32467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:41.053936 32475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:41.056553 32475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:41.073402 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:41.050895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.8.51.125:42815)
0809 08:02:41.051017 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.051021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.063485 (+ 12464us) server_negotiation.cc:407] Connection header received
0809 08:02:41.063654 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.063657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.063707 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.063757 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.064589 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.065347 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.066493 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.066818 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.066887 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.068528 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:41.068532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:41.068535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:41.068559 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:41.071503 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.072023 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.072027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.072029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.072130 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.072471 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.072475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.072477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.072679 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:41.072776 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:41.073142 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 08:02:41.073255 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 08:02:41.076653 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:41.049848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48144 (local address 127.8.51.126:33355)
0809 08:02:41.049970 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.049974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.058852 (+ 8878us) server_negotiation.cc:407] Connection header received
0809 08:02:41.058994 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.058997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.059049 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.059127 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.065925 (+ 6798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.066681 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.067819 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.068236 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.068313 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.070273 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:41.070278 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:41.070283 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:41.070315 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:41.072164 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.075244 (+ 3080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.075248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.075250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.075335 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.075657 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.075660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.075662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.075874 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:41.075993 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:41.076363 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 08:02:41.076487 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 08:02:41.076759 32425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:41.050257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44250 (local address 127.8.51.124:45271)
0809 08:02:41.050363 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.050367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.059187 (+ 8820us) server_negotiation.cc:407] Connection header received
0809 08:02:41.059350 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.059356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.059409 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.059461 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.060323 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.061119 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.062352 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:41.062718 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:41.062792 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:41.064681 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:41.064685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:41.064688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:41.064717 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:41.066535 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.075339 (+ 8804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.075345 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.075348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.075449 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:41.075757 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:41.075761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:41.075762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:41.075981 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:41.076092 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:41.076475 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 08:02:41.076603 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 08:02:41.079802 32313 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [term 1 FOLLOWER]: Refusing update from remote peer 3da261a6bb5340fc89b8d3dcb040fdda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:41.080955 32469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [LEADER]: Connected to new peer: Peer: permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:41.083066 32394 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [term 1 FOLLOWER]: Refusing update from remote peer 3da261a6bb5340fc89b8d3dcb040fdda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:41.083663 32469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:41.088155 32443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3da261a6bb5340fc89b8d3dcb040fdda. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.088255 32443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.091427 32428 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3da261a6bb5340fc89b8d3dcb040fdda. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.091531 32428 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.098392 32469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.098501 32469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:41.099611 32443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.099706 32443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.100198 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.100292 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:41.101222 32428 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da261a6bb5340fc89b8d3dcb040fdda" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 33355 } } peers { permanent_uuid: "91423f4f926a4ce486eee953bc1e1884" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 42815 } } peers { permanent_uuid: "b2e77315de8d47249d9ad5a310537917" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 45271 } } }
I20260809 08:02:41.101338 32428 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:41.102138 32483 mvcc.cc:205] Tried to move back new op lower bound from 7316531450160193536 to 7316531450052739072. Current Snapshot: MvccSnapshot[applied={T|T < 7316531450160193536}]
I20260809 08:02:41.102339 32480 mvcc.cc:205] Tried to move back new op lower bound from 7316531450160193536 to 7316531450052739072. Current Snapshot: MvccSnapshot[applied={T|T < 7316531450160193536}]
I20260809 08:02:41.108326 32475 catalog_manager.cc:1347] Generated new cluster ID: fe90c32865be4c91b9379366732dcd97
I20260809 08:02:41.108383 32475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:41.121994 32475 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:41.123315 32475 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:41.138080 32475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3da261a6bb5340fc89b8d3dcb040fdda: Generated new TSK 0
I20260809 08:02:41.139199 32475 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 08:02:41.178442 32265 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.175134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.8.51.126:33355)
0809 08:02:41.175269 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.175276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.177278 (+ 2002us) server_negotiation.cc:407] Connection header received
0809 08:02:41.177492 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.177496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.177550 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.177645 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.178304 (+ 659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48150: BlockingRecv error: recv got EOF from 127.0.0.1:48150 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 08:02:41.180073 32425 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.175956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44258 (local address 127.8.51.124:45271)
0809 08:02:41.176075 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.176079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.179181 (+ 3102us) server_negotiation.cc:407] Connection header received
0809 08:02:41.179349 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.179352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.179400 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.179450 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.179954 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44258: BlockingRecv error: recv got EOF from 127.0.0.1:44258 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 08:02:41.181694 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.176655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.8.51.125:42815)
0809 08:02:41.176771 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.176778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.180592 (+ 3814us) server_negotiation.cc:407] Connection header received
0809 08:02:41.180909 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.180913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.180965 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.181018 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.181564 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49024: BlockingRecv error: recv got EOF from 127.0.0.1:49024 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 08:02:41.186432 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.184894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49032 (local address 127.8.51.125:42815)
0809 08:02:41.184991 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.184995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.185445 (+ 450us) server_negotiation.cc:407] Connection header received
0809 08:02:41.185713 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.185716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.185786 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.185841 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.186346 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49032: BlockingRecv error: recv got EOF from 127.0.0.1:49032 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 08:02:41.191787 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.190322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49036 (local address 127.8.51.125:42815)
0809 08:02:41.190421 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.190425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.190888 (+ 463us) server_negotiation.cc:407] Connection header received
0809 08:02:41.191076 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.191079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.191140 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.191195 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.191704 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49036: BlockingRecv error: recv got EOF from 127.0.0.1:49036 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 08:02:41.197584 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.196023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.8.51.125:42815)
0809 08:02:41.196132 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.196136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.196619 (+ 483us) server_negotiation.cc:407] Connection header received
0809 08:02:41.196806 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.196809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.196854 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.196907 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.197498 (+ 591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49044: BlockingRecv error: recv got EOF from 127.0.0.1:49044 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 08:02:41.205080 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.203749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49056 (local address 127.8.51.125:42815)
0809 08:02:41.203861 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.203865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.204315 (+ 450us) server_negotiation.cc:407] Connection header received
0809 08:02:41.204473 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.204476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.204516 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.204561 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.204996 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49056: BlockingRecv error: recv got EOF from 127.0.0.1:49056 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 08:02:41.217023 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.215542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49060 (local address 127.8.51.125:42815)
0809 08:02:41.215649 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.215653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.216138 (+ 485us) server_negotiation.cc:407] Connection header received
0809 08:02:41.216328 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.216331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.216375 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.216423 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.216926 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49060: BlockingRecv error: recv got EOF from 127.0.0.1:49060 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 08:02:41.237532 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.236072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49072 (local address 127.8.51.125:42815)
0809 08:02:41.236210 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.236214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.236535 (+ 321us) server_negotiation.cc:407] Connection header received
0809 08:02:41.236733 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.236737 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.236790 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.236882 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.237397 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49072: BlockingRecv error: recv got EOF from 127.0.0.1:49072 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 08:02:41.272704 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.271641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49082 (local address 127.8.51.125:42815)
0809 08:02:41.271819 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.271822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.271858 (+ 36us) server_negotiation.cc:407] Connection header received
0809 08:02:41.272011 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.272014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.272059 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.272131 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.272575 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49082: BlockingRecv error: recv got EOF from 127.0.0.1:49082 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 08:02:41.340083 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.338783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49092 (local address 127.8.51.125:42815)
0809 08:02:41.338932 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.338936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.339174 (+ 238us) server_negotiation.cc:407] Connection header received
0809 08:02:41.339319 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.339322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.339369 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.339441 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.339950 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49092: BlockingRecv error: recv got EOF from 127.0.0.1:49092 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 08:02:41.471652 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.470332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42154 (local address 127.8.51.125:42815)
0809 08:02:41.470515 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.470520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.470668 (+ 148us) server_negotiation.cc:407] Connection header received
0809 08:02:41.470868 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.470871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.470919 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.471015 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.471505 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42154: BlockingRecv error: recv got EOF from 127.0.0.1:42154 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 08:02:41.731172 32346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:41.729981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42156 (local address 127.8.51.125:42815)
0809 08:02:41.730127 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:41.730131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:41.730265 (+ 134us) server_negotiation.cc:407] Connection header received
0809 08:02:41.730406 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:41.730409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:41.730472 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:41.730541 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:41.731049 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42156: BlockingRecv error: recv got EOF from 127.0.0.1:42156 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 08:02:42.019969 32439 catalog_manager.cc:1259] Loaded cluster ID: fe90c32865be4c91b9379366732dcd97
I20260809 08:02:42.020059 32439 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: loading cluster ID for follower catalog manager: success
I20260809 08:02:42.021790 32439 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: acquiring CA information for follower catalog manager: success
I20260809 08:02:42.023006 32439 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b2e77315de8d47249d9ad5a310537917: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:02:42.032250 32454 catalog_manager.cc:1259] Loaded cluster ID: fe90c32865be4c91b9379366732dcd97
I20260809 08:02:42.032312 32454 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: loading cluster ID for follower catalog manager: success
I20260809 08:02:42.033934 32454 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: acquiring CA information for follower catalog manager: success
I20260809 08:02:42.035076 32454 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 91423f4f926a4ce486eee953bc1e1884: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:02:42.249442 32553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:42.245265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42162 (local address 127.8.51.125:42815)
0809 08:02:42.245517 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:42.245523 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:42.245651 (+ 128us) server_negotiation.cc:407] Connection header received
0809 08:02:42.245858 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:42.245861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:42.245991 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:42.246142 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:42.246419 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.246955 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.247871 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.248108 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.248222 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:42.248560 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:42.249011 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:42.249167 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:42.249211 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 08:02:42.249267 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":67,"threads_started":1}
I20260809 08:02:42.256106 32559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:42.252719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51500 (local address 127.8.51.124:45271)
0809 08:02:42.252940 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:42.252944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:42.252956 (+ 12us) server_negotiation.cc:407] Connection header received
0809 08:02:42.253034 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:42.253037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:42.253147 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:42.253247 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:42.253435 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.254025 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.254822 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.255045 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.255120 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:42.255377 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:42.255808 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:42.255896 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:42.255947 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 08:02:42.255993 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260809 08:02:42.263046 32559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:42.259722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51502 (local address 127.8.51.124:45271)
0809 08:02:42.259844 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:42.259850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:42.260116 (+ 266us) server_negotiation.cc:407] Connection header received
0809 08:02:42.260291 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:42.260294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:42.260339 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:42.260407 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:42.260631 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.261091 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262048 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.262260 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262367 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:42.262615 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:42.262677 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:42.262762 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:42.262852 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 08:02:42.262898 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 08:02:42.263783 32553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:42.259014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42164 (local address 127.8.51.125:42815)
0809 08:02:42.259203 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:42.259208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:42.259227 (+ 19us) server_negotiation.cc:407] Connection header received
0809 08:02:42.259372 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:42.259375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:42.259429 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:42.259514 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:42.259777 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.260514 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262435 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.262766 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262856 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:42.263304 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:42.263385 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:42.263433 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:42.263605 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 08:02:42.263661 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260809 08:02:42.264516 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:42.258975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.8.51.126:33355)
0809 08:02:42.259205 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:42.259209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:42.259699 (+ 490us) server_negotiation.cc:407] Connection header received
0809 08:02:42.259805 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:42.259808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:42.259955 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:42.260074 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:42.260345 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.260970 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262435 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:42.262791 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:42.262882 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:42.263584 (+ 702us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:42.264089 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:42.264177 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:42.264257 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 08:02:42.264315 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":83,"threads_started":1}
I20260809 08:02:42.272830 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32194
I20260809 08:02:42.282016 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32269
I20260809 08:02:42.288702 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32347
2026-08-09T08:02:42Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3124 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 08:02:42 dist-test-slave-njxd krb5kdc[32570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 08:02:42 dist-test-slave-njxd krb5kdc[32570](info): set up 2 sockets
Aug 09 08:02:42 dist-test-slave-njxd krb5kdc[32570](info): commencing operation
krb5kdc: starting...
W20260809 08:02:43.334404 8397 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/test-user.keytab.
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T08:02:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T08:02:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.51.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
Entry for principal kudu/127.8.51.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab.
I20260809 08:02:43.456384 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43059
--webserver_interface=127.8.51.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 08:02:43.565579 32583 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:43.565913 32583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:43.565956 32583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:43.566020 32583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 08:02:43.569859 32583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:43.569936 32583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:43.569972 32583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:43.570004 32583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:43.570031 32583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:43.575032 32583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.126.keytab
--principal=kudu/127.8.51.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.126:43059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.51.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:43.576006 32583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:43.576983 32583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:43.585013 32591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.585047 32588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.585016 32589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:43.585325 32583 server_base.cc:1034] running on GCE node
I20260809 08:02:43.585958 32583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:43.587014 32583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:43.588166 32583 hybrid_clock.cc:648] HybridClock initialized: now 1786262563588156 us; error 38 us; skew 500 ppm
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:43.590910 32583 init.cc:377] Logged in from keytab as kudu/127.8.51.126@KRBTEST.COM (short username kudu)
I20260809 08:02:43.591727 32583 webserver.cc:460] Webserver started at http://127.8.51.126:44933/ using document root <none> and password file <none>
I20260809 08:02:43.592262 32583 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:43.592320 32583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:43.592545 32583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:43.594544 32583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data/instance:
uuid: "049da26234644d57bd04c00772e50622"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "d3a6e96efe85cc0ac89ed7a0b603b9b5"
server_key_iv: "bdc6345e686ea9b46693307111954624"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.595118 32583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance:
uuid: "049da26234644d57bd04c00772e50622"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "d3a6e96efe85cc0ac89ed7a0b603b9b5"
server_key_iv: "bdc6345e686ea9b46693307111954624"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.598565 32583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 08:02:43.600728 32598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:43.601864 32583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 08:02:43.601990 32583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal
uuid: "049da26234644d57bd04c00772e50622"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "d3a6e96efe85cc0ac89ed7a0b603b9b5"
server_key_iv: "bdc6345e686ea9b46693307111954624"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.602092 32583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:43.612818 32583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:43.615610 32583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:43.615828 32583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:43.622400 32583 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.126:43059
I20260809 08:02:43.622704 32652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.126:43059 every 8 connection(s)
I20260809 08:02:43.623304 32583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/data/info.pb
I20260809 08:02:43.625926 32653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:43.629323 32653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:43.632306 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32583
I20260809 08:02:43.632431 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-0/wal/instance
I20260809 08:02:43.632731 8397 external_mini_cluster.cc:1428] Setting key f98cc344d4afe620e2b4fd8a9c29939f
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.125@KRBTEST.COM; defaulting to no policy
I20260809 08:02:43.644058 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.631447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43059 (local address 127.0.0.1:53502)
0809 08:02:43.631872 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.631911 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:43.632890 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:43.633566 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:43.633589 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:43.633970 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:43.634223 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.634235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.635400 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.635403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.636104 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.636112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.636735 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.636739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.636831 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.637428 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:43.637444 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:43.639293 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:43.641152 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.641165 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.641176 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.641473 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.641883 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.641887 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.641889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.642038 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.642624 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:43.642629 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:43.642806 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 08:02:43.642955 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 08:02:43.643296 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":108,"thread_start_us":102,"threads_started":1}
I20260809 08:02:43.644061 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.632232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53502 (local address 127.8.51.126:43059)
0809 08:02:43.632516 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:43.632526 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:43.632569 (+ 43us) server_negotiation.cc:407] Connection header received
0809 08:02:43.633181 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:43.633186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:43.633392 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:43.633566 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:43.634367 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.635259 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.636228 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.636582 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.636752 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.639437 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:43.639443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:43.639452 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:43.639472 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:43.641034 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.641631 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.641636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.641637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.641778 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.642131 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.642134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.642153 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.642479 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:43.642581 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:43.643039 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 08:02:43.643214 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":184,"thread_start_us":85,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.125@KRBTEST.COM" created.
I20260809 08:02:43.646555 32653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:43.647269 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.647037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53262)
0809 08:02:43.647150 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.647215 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 08:02:43.647470 32599 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
I20260809 08:02:43.648288 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.648080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53274)
0809 08:02:43.648190 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.648238 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 08:02:43.648451 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:38797: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
Entry for principal kudu/127.8.51.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab.
I20260809 08:02:43.660579 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:38797
--webserver_interface=127.8.51.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:02:43.697680 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } attempt: 1
I20260809 08:02:43.698589 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.698288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53280)
0809 08:02:43.698444 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.698505 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 08:02:43.699308 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.699083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53296)
0809 08:02:43.699200 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.699249 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 08:02:43.699434 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:38797: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
W20260809 08:02:43.766283 32660 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:43.766574 32660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:43.766641 32660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:43.766711 32660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 08:02:43.767604 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } attempt: 2
I20260809 08:02:43.768388 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.768092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53302)
0809 08:02:43.768249 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.768318 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 08:02:43.769078 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.768867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53316)
0809 08:02:43.768969 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.769012 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 08:02:43.769238 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.125:38797: Network error: Client connection negotiation failed: client connection to 127.8.51.125:38797: connect: Connection refused (error 111)
W20260809 08:02:43.770764 32660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:43.770838 32660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:43.770879 32660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:43.770933 32660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:43.770970 32660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:43.776058 32660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.125.keytab
--principal=kudu/127.8.51.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.125:38797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.51.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:43.777027 32660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:43.778050 32660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:43.786012 32669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.785986 32666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.786118 32665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:43.786134 32660 server_base.cc:1034] running on GCE node
I20260809 08:02:43.786816 32660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:43.787789 32660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:43.788970 32660 hybrid_clock.cc:648] HybridClock initialized: now 1786262563788956 us; error 23 us; skew 500 ppm
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:43.791602 32660 init.cc:377] Logged in from keytab as kudu/127.8.51.125@KRBTEST.COM (short username kudu)
I20260809 08:02:43.792455 32660 webserver.cc:460] Webserver started at http://127.8.51.125:35031/ using document root <none> and password file <none>
I20260809 08:02:43.792976 32660 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:43.793067 32660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:43.793293 32660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:43.795249 32660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data/instance:
uuid: "7ed3ebe0946445919840a2e223f09ff9"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "c737312fe13b2034f12cccf736404a90"
server_key_iv: "1f10c1aa15bb9b097131be34ed7a7656"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.795830 32660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal/instance:
uuid: "7ed3ebe0946445919840a2e223f09ff9"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "c737312fe13b2034f12cccf736404a90"
server_key_iv: "1f10c1aa15bb9b097131be34ed7a7656"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.799280 32660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 08:02:43.801532 32676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:43.802747 32660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:43.802870 32660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal
uuid: "7ed3ebe0946445919840a2e223f09ff9"
format_stamp: "Formatted at 2026-08-09 08:02:43 on dist-test-slave-njxd"
server_key: "c737312fe13b2034f12cccf736404a90"
server_key_iv: "1f10c1aa15bb9b097131be34ed7a7656"
server_key_version: "encryptionkey@0"
I20260809 08:02:43.802968 32660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:43.817860 32660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:43.820685 32660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:43.820888 32660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:43.827919 32660 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.125:38797
I20260809 08:02:43.828230 32729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.125:38797 every 8 connection(s)
I20260809 08:02:43.828918 32660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/data/info.pb
I20260809 08:02:43.831658 32730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:43.835445 32730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:43.836894 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32660
I20260809 08:02:43.837039 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-1/wal/instance
I20260809 08:02:43.837373 8397 external_mini_cluster.cc:1428] Setting key ed1d1b05cb110a1edb06e6dd1c6a60ba
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.51.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.51.124@KRBTEST.COM" created.
I20260809 08:02:43.850778 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.837346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53518 (local address 127.8.51.126:43059)
0809 08:02:43.837501 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:43.837507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:43.838538 (+ 1031us) server_negotiation.cc:407] Connection header received
0809 08:02:43.839884 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:43.839887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:43.839951 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:43.840036 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:43.841419 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.841996 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.843867 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.844241 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.844334 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.847163 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:43.847166 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:43.847168 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:43.847194 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:43.848479 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.849026 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.849029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.849031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.849181 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.849531 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.849534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.849536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.849827 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:43.849937 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:43.850459 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 08:02:43.850602 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 08:02:43.851552 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.837802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43059 (local address 127.0.0.1:53518)
0809 08:02:43.838351 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.838410 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:43.839654 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:43.840210 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:43.840218 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:43.840559 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:43.841254 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.841277 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.842164 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.842171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.843705 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.843720 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.844413 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.844421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.844641 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.845278 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:43.845297 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:43.846946 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:43.848609 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.848615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.848631 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.848883 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.849278 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.849282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.849284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.849422 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.849936 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:43.849943 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:43.850209 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 08:02:43.850404 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 08:02:43.850724 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":114,"threads_started":1}
I20260809 08:02:43.853081 32730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:43.860406 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } attempt: 3
I20260809 08:02:43.863600 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.853749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53332)
0809 08:02:43.853854 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.853865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:43.853927 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:43.854569 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:43.854576 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:43.854776 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:43.854925 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.854936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.855911 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.855918 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.856877 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.856891 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.857478 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.857483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.857632 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.858161 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:43.858179 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:43.859463 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:43.861861 (+ 2398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.861867 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.861869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.862110 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.862504 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.862510 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.862512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.862605 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.863101 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:43.863107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:43.863211 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 08:02:43.863320 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 08:02:43.863440 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 08:02:43.863862 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.853906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.8.51.125:38797)
0809 08:02:43.854216 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:43.854224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:43.854240 (+ 16us) server_negotiation.cc:407] Connection header received
0809 08:02:43.854270 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:43.854274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:43.854415 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:43.854519 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:43.855061 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.855775 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.857006 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.857350 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.857431 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.859645 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:43.859658 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:43.859673 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:43.859705 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:43.861731 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.862266 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.862272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.862274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.862378 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.862707 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.862710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.862712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.862980 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:43.863142 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:43.863400 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 08:02:43.863593 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":150,"threads_started":1}
I20260809 08:02:43.866291 32730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:43.867112 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.866797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53114)
0809 08:02:43.866925 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.867050 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 08:02:43.867338 32678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
Entry for principal kudu/127.8.51.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab.
I20260809 08:02:43.868225 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.867995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53128)
0809 08:02:43.868114 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.868164 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 08:02:43.868422 32730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
I20260809 08:02:43.868924 8397 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
/tmp/dist-test-taskzQyOdB/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:39671
--webserver_interface=127.8.51.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.51.84:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 08:02:43.870775 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.861223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.8.51.125:38797)
0809 08:02:43.861530 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:43.861539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:43.861553 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:02:43.861604 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:43.861606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:43.861652 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:43.861753 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:43.862259 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.863064 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.864179 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.864515 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.864640 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.866941 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:43.866944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:43.866947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:43.866975 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:43.868935 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.869457 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.869462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.869463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.869546 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:43.869918 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:43.869923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:43.869924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:43.870090 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:43.870196 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:43.870554 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 08:02:43.870655 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":108,"threads_started":1}
I20260809 08:02:43.870808 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.861142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53340)
0809 08:02:43.861352 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.861388 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:43.861485 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:43.861772 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:43.861775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:43.861966 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:43.862105 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.862112 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.863215 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.863219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.864063 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:43.864074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:43.864646 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:43.864652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:43.864792 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:43.865226 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:43.865240 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:43.866775 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:43.869164 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.869166 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.869168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.869357 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.869736 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:43.869739 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:43.869741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:43.869823 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:43.870194 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:43.870197 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:43.870331 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 08:02:43.870458 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 08:02:43.870606 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 08:02:43.871760 32653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } has no permanent_uuid. Determining permanent_uuid...
I20260809 08:02:43.872445 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.872232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53136)
0809 08:02:43.872344 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.872390 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 08:02:43.873126 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.872904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53140)
0809 08:02:43.873040 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.873081 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 08:02:43.873306 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
I20260809 08:02:43.904458 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 1
I20260809 08:02:43.905316 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.905025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53144)
0809 08:02:43.905171 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.905239 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 08:02:43.906140 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.905865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53150)
0809 08:02:43.906008 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.906064 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 08:02:43.906333 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
I20260809 08:02:43.917755 32730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 1
I20260809 08:02:43.918536 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.918276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53166)
0809 08:02:43.918411 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.918468 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 08:02:43.919239 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.919035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53174)
0809 08:02:43.919137 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.919188 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 08:02:43.919363 32730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
W20260809 08:02:43.979064 32738 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 08:02:43.979357 32738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 08:02:43.979442 32738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 08:02:43.979516 32738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 08:02:43.981544 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 2
I20260809 08:02:43.982504 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.982172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53176)
0809 08:02:43.982342 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.982412 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 08:02:43.983243 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.983013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53188)
0809 08:02:43.983133 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.983188 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 08:02:43.983371 32653 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
W20260809 08:02:43.983829 32738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 08:02:43.983899 32738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 08:02:43.983943 32738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 08:02:43.983990 32738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 08:02:43.984025 32738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 08:02:43.987537 32730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 2
I20260809 08:02:43.988144 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.987903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53204)
0809 08:02:43.988019 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.988084 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 08:02:43.988777 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:43.988576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53206)
0809 08:02:43.988676 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:43.988719 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 08:02:43.988895 32730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.51.124:39671: Network error: Client connection negotiation failed: client connection to 127.8.51.124:39671: connect: Connection refused (error 111)
I20260809 08:02:43.989203 32738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.51.84:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.51.126:43059,127.8.51.125:38797,127.8.51.124:39671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/krb5kdc/kudu_127.8.51.124.keytab
--principal=kudu/127.8.51.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.51.124:39671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.51.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 07:01:58 UTC on ccycloud.quasar-fnohdt.root.comops.site
build id 4575851
I20260809 08:02:43.990264 32738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 08:02:43.991235 32738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 08:02:43.999488 32745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.999493 32744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 08:02:43.999493 32747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 08:02:43.999872 32738 server_base.cc:1034] running on GCE node
I20260809 08:02:44.000428 32738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 08:02:44.001467 32738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 08:02:44.002628 32738 hybrid_clock.cc:648] HybridClock initialized: now 1786262564002613 us; error 50 us; skew 500 ppm
Aug 09 08:02:43 dist-test-slave-njxd krb5kdc[32570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 08:02:44.005273 32738 init.cc:377] Logged in from keytab as kudu/127.8.51.124@KRBTEST.COM (short username kudu)
I20260809 08:02:44.006335 32738 webserver.cc:460] Webserver started at http://127.8.51.124:34913/ using document root <none> and password file <none>
I20260809 08:02:44.006907 32738 fs_manager.cc:359] Metadata directory not provided
I20260809 08:02:44.007019 32738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 08:02:44.007251 32738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 08:02:44.009151 32738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data/instance:
uuid: "c738dcc867c4443d8162099ab9cf4892"
format_stamp: "Formatted at 2026-08-09 08:02:44 on dist-test-slave-njxd"
server_key: "a3e2118587b73c47b97aeafc8710c3d2"
server_key_iv: "77aebbdee234d0cccf51a33458a81570"
server_key_version: "encryptionkey@0"
I20260809 08:02:44.009757 32738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal/instance:
uuid: "c738dcc867c4443d8162099ab9cf4892"
format_stamp: "Formatted at 2026-08-09 08:02:44 on dist-test-slave-njxd"
server_key: "a3e2118587b73c47b97aeafc8710c3d2"
server_key_iv: "77aebbdee234d0cccf51a33458a81570"
server_key_version: "encryptionkey@0"
I20260809 08:02:44.013300 32738 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 08:02:44.015658 32754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 08:02:44.016819 32738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 08:02:44.016952 32738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data,/tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal
uuid: "c738dcc867c4443d8162099ab9cf4892"
format_stamp: "Formatted at 2026-08-09 08:02:44 on dist-test-slave-njxd"
server_key: "a3e2118587b73c47b97aeafc8710c3d2"
server_key_iv: "77aebbdee234d0cccf51a33458a81570"
server_key_version: "encryptionkey@0"
I20260809 08:02:44.017055 32738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 08:02:44.030779 32738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 08:02:44.033363 32738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 08:02:44.033568 32738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 08:02:44.040447 32738 rpc_server.cc:307] RPC server started. Bound to: 127.8.51.124:39671
I20260809 08:02:44.040725 340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.51.124:39671 every 8 connection(s)
I20260809 08:02:44.041380 32738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/data/info.pb
I20260809 08:02:44.044098 341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 08:02:44.046298 8397 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu as pid 32738
I20260809 08:02:44.046447 8397 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzQyOdB/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786262281998942-8397-0/minicluster-data/master-2/wal/instance
I20260809 08:02:44.046731 8397 external_mini_cluster.cc:1428] Setting key 89c83bafad9d166d9350c0d6ad3ae9f8
I20260809 08:02:44.048161 341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:02:44.059894 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.050403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.8.51.126:43059)
0809 08:02:44.050543 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.050548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.050562 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:02:44.050742 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.050744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.050794 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.050888 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.051564 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.052213 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.053456 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.053797 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.053894 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.056275 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.056284 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.056286 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.056307 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.057943 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.058440 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.058444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.058446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.058525 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.058854 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.058859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.058860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.059033 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.059145 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.059613 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.059727 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 08:02:44.060789 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.047966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53220 (local address 127.8.51.124:39671)
0809 08:02:44.048385 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.048398 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.048430 (+ 32us) server_negotiation.cc:407] Connection header received
0809 08:02:44.049050 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.049067 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.049376 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.049799 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.050666 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.051867 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.052971 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.053515 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.053694 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.056686 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.056691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.056700 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.056720 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.058248 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.058683 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.058687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.058688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.058759 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.059035 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.059040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.059042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.059358 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.059579 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.059783 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.059919 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":279,"thread_start_us":134,"threads_started":1}
I20260809 08:02:44.060789 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.049869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.126:43059 (local address 127.0.0.1:53534)
0809 08:02:44.050457 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:44.050510 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:44.050630 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:44.050934 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:44.050938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:44.051266 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:44.051409 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.051417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.052332 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.052335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.053321 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.053330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.053955 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.053962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.054043 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.054427 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:44.054446 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:44.056133 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:44.058054 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.058065 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.058075 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.058335 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.058619 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.058623 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.058625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.058758 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.059143 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:44.059150 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:44.059371 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 08:02:44.059558 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 08:02:44.059850 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":47,"spinlock_wait_cycles":896,"thread_start_us":86,"threads_started":1}
I20260809 08:02:44.062364 341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.126@KRBTEST.COM
I20260809 08:02:44.071189 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.062846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.125:38797 (local address 127.0.0.1:53350)
0809 08:02:44.062982 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:44.062999 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:44.063078 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:44.063434 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:44.063443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:44.063597 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:44.063722 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.063730 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.064619 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.064622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.065301 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.065310 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.065845 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.065848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.065915 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.066322 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:44.066341 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:44.067698 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:44.069685 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.069688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.069690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.069904 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.070200 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.070204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.070206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.070292 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.070671 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:44.070674 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:44.070772 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 08:02:44.070889 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 08:02:44.071009 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 08:02:44.071220 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.062967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53350 (local address 127.8.51.125:38797)
0809 08:02:44.063101 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.063106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.063124 (+ 18us) server_negotiation.cc:407] Connection header received
0809 08:02:44.063172 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.063175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.063226 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.063305 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.063850 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.064496 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.065413 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.065735 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.065837 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.067849 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.067851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.067853 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.067874 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.069489 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.070012 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.070015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.070018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.070103 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.070383 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.070388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.070390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.070572 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.070679 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.070939 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.071061 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 08:02:44.071761 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.063321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53536 (local address 127.8.51.126:43059)
0809 08:02:44.063434 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.063438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.063450 (+ 12us) server_negotiation.cc:407] Connection header received
0809 08:02:44.063485 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.063486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.063516 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.063582 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.064205 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.064798 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.065749 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.066017 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.066153 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.068525 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.068528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.068531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.068561 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.070158 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.070583 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.070586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.070588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.070672 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.070958 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.070962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.070964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.071139 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.071384 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.071505 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.071615 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 08:02:44.072299 341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.124@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.51.125@KRBTEST.COM
I20260809 08:02:44.080057 32730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 3
I20260809 08:02:44.080325 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.072767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53232)
0809 08:02:44.072960 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:44.072972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:44.073058 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:44.073275 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:44.073278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:44.073442 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:44.073495 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.073500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.074178 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.074184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.074687 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.074693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.075134 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.075137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.075248 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.075687 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:44.075697 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:44.076902 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:44.078903 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.078906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.078907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.079085 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.079342 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.079347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.079349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.079456 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.079818 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:44.079821 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:44.079895 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 08:02:44.080009 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 08:02:44.080147 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":15}
I20260809 08:02:44.080325 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.072849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53232 (local address 127.8.51.124:39671)
0809 08:02:44.072947 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.072953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.073016 (+ 63us) server_negotiation.cc:407] Connection header received
0809 08:02:44.073139 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.073142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.073176 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.073265 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.073618 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.074083 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.074795 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.075031 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.075137 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.077038 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.077043 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.077047 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.077076 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.078529 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.079179 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.079185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.079188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.079260 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.079573 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.079575 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.079577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.079730 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.079828 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.080104 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.080190 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":31}
I20260809 08:02:44.082095 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.073038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.8.51.125:38797)
0809 08:02:44.073149 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.073155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.073169 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:02:44.073275 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.073279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.073314 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.073424 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.074048 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.074536 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.075265 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.075601 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.075698 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.078674 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.078677 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.078680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.078702 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.080311 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.080770 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.080776 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.080778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.080870 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.081209 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.081213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.081215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.081427 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.081697 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.081823 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.081934 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 08:02:44.082533 32653 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } attempt: 3
I20260809 08:02:44.084216 341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: Bootstrap starting.
I20260809 08:02:44.085508 8397 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.125@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:02:44.087177 341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:44.088022 341 log.cc:824] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:44.086689 32626 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "049da26234644d57bd04c00772e50622"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53536
Aug 09 08:02:44 dist-test-slave-njxd krb5kdc[32570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786262563, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.51.126@KRBTEST.COM for kudu/127.8.51.124@KRBTEST.COM
I20260809 08:02:44.090562 341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: No bootstrap required, opened a new log
I20260809 08:02:44.091264 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.081065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.8.51.124:39671)
0809 08:02:44.081190 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.081195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.081205 (+ 10us) server_negotiation.cc:407] Connection header received
0809 08:02:44.081235 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.081237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.081277 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.081351 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.081861 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.082727 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.083948 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.084227 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.084627 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.086495 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.086498 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.086501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.086522 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.089045 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.089512 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.089515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.089517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.089631 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.090009 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.090015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.090019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.090249 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.090355 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.090970 (+ 615us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.091085 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 08:02:44.091404 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.080422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53248)
0809 08:02:44.080599 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:44.080614 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:44.080684 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:44.081394 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:44.081398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:44.081635 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:44.081733 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.081740 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.082859 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.082865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.083597 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.083607 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.084361 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.084364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.084435 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.084876 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:44.084888 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:44.086363 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:44.089162 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.089179 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.089181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.089407 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.089783 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.089786 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.089788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.089894 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.090637 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:44.090642 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:44.090736 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 08:02:44.090853 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 08:02:44.091237 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 08:02:44.093832 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.082875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.51.124:39671 (local address 127.0.0.1:53256)
0809 08:02:44.083755 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0809 08:02:44.083769 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 08:02:44.083833 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 08:02:44.084127 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 08:02:44.084130 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 08:02:44.084301 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 08:02:44.084405 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.084413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.086819 (+ 2406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.086823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.087570 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 08:02:44.087581 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.088144 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.088148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 08:02:44.088225 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.088627 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 08:02:44.088643 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 08:02:44.089923 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 08:02:44.092141 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.092143 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.092145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.092424 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.092751 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 08:02:44.092754 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 08:02:44.092756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 08:02:44.092837 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 08:02:44.093256 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 08:02:44.093260 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 08:02:44.093364 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 08:02:44.093508 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 08:02:44.093692 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809}
I20260809 08:02:44.094453 346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.083059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53256 (local address 127.8.51.124:39671)
0809 08:02:44.083893 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.083904 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.083917 (+ 13us) server_negotiation.cc:407] Connection header received
0809 08:02:44.083950 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.083953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.083990 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.084708 (+ 718us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.084807 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.086722 (+ 1915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.087689 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.088017 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.088134 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.090090 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.090093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.090095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.090114 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.092011 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.092555 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.092558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.092560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.092648 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.092943 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.092945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.092947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.093136 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.094111 (+ 975us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.094184 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.094287 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":116,"threads_started":1}
I20260809 08:02:44.094537 32730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: Bootstrap starting.
I20260809 08:02:44.095131 341 raft_consensus.cc:348] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.095357 341 raft_consensus.cc:729] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c738dcc867c4443d8162099ab9cf4892, State: Initialized, Role: FOLLOWER
I20260809 08:02:44.095667 341 consensus_queue.cc:260] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.096117 348 sys_catalog.cc:455] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.096292 348 sys_catalog.cc:458] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.096837 32730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:44.096966 341 sys_catalog.cc:564] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:44.097538 32730 log.cc:824] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:44.099591 32730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: No bootstrap required, opened a new log
I20260809 08:02:44.100212 32653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: Bootstrap starting.
W20260809 08:02:44.101787 361 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:44.101864 361 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:44.102648 32653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: Neither blocks nor log segments found. Creating new log.
I20260809 08:02:44.103009 32730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.103163 32730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed3ebe0946445919840a2e223f09ff9, State: Initialized, Role: FOLLOWER
I20260809 08:02:44.103392 32730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.103462 32653 log.cc:824] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: Log is configured to *not* fsync() on all Append() calls
I20260809 08:02:44.103753 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.103880 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.105060 32730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:44.107932 32653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: No bootstrap required, opened a new log
I20260809 08:02:44.105510 32738 master_runner.cc:186] Error getting master registration for 127.8.51.126:43059: OK, instance_id { permanent_uuid: "049da26234644d57bd04c00772e50622" instance_seqno: 1786262563620552 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:02:44.109067 32738 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 08:02:44.110065 378 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:44.110141 378 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:44.109915 32660 master_runner.cc:186] Error getting master registration for 127.8.51.126:43059: OK, instance_id { permanent_uuid: "049da26234644d57bd04c00772e50622" instance_seqno: 1786262563620552 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 08:02:44.113305 32660 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:02:44.114702 32653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.114929 32653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 049da26234644d57bd04c00772e50622, State: Initialized, Role: FOLLOWER
I20260809 08:02:44.115265 32653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.116516 32653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 08:02:44.116586 32626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 08:02:44.116721 32626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 0 FOLLOWER]: Advancing to term 1
W20260809 08:02:44.117300 32604 tablet.cc:2369] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 08:02:44.118088 32626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.119572 32703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "049da26234644d57bd04c00772e50622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7ed3ebe0946445919840a2e223f09ff9"
I20260809 08:02:44.119640 32626 leader_election.cc:288] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [CANDIDATE]: Term 1 election: Requested vote from peers 7ed3ebe0946445919840a2e223f09ff9 (127.8.51.125:38797), c738dcc867c4443d8162099ab9cf4892 (127.8.51.124:39671)
I20260809 08:02:44.119799 32703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:44.119990 314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "049da26234644d57bd04c00772e50622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c738dcc867c4443d8162099ab9cf4892"
I20260809 08:02:44.120239 314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [term 0 FOLLOWER]: Advancing to term 1
I20260809 08:02:44.121057 32703 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 049da26234644d57bd04c00772e50622 in term 1.
I20260809 08:02:44.121402 314 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 049da26234644d57bd04c00772e50622 in term 1.
I20260809 08:02:44.121539 32599 leader_election.cc:302] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 049da26234644d57bd04c00772e50622, 7ed3ebe0946445919840a2e223f09ff9; no voters:
W20260809 08:02:44.126960 391 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 08:02:44.127035 391 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 08:02:44.127554 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.127679 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.127763 380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 08:02:44.127838 380 raft_consensus.cc:686] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [term 1 LEADER]: Becoming Leader. State: Replica: 049da26234644d57bd04c00772e50622, State: Running, Role: LEADER
I20260809 08:02:44.128108 380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } }
I20260809 08:02:44.128523 32583 master_runner.cc:263] No leader master found from master 049da26234644d57bd04c00772e50622
I20260809 08:02:44.128589 32583 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 08:02:44.129662 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049da26234644d57bd04c00772e50622. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.129760 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:44.139132 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.123235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53364 (local address 127.8.51.125:38797)
0809 08:02:44.123786 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.123791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.129967 (+ 6176us) server_negotiation.cc:407] Connection header received
0809 08:02:44.130161 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.130164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.130220 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.130268 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.131233 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.131966 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.133189 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.133518 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.133639 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.135587 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.135591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.135594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.135620 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.137259 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.137768 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.137771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.137773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.137853 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.138144 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.138147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.138150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.138409 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.138516 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.138840 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.138958 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467}
I20260809 08:02:44.140719 346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.130440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53266 (local address 127.8.51.124:39671)
0809 08:02:44.130549 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.130553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.131672 (+ 1119us) server_negotiation.cc:407] Connection header received
0809 08:02:44.131830 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.131833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.131874 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.131918 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.132820 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.133616 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.134758 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.135132 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.135202 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.137279 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.137282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.137285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.137309 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.138975 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.139458 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.139461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.139463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.139556 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.139829 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.139833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.139834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.140015 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.140136 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.140460 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.140577 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 08:02:44.145862 400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 08:02:44.146973 400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 08:02:44.149204 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:44.130898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53544 (local address 127.8.51.126:43059)
0809 08:02:44.130993 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.130997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.136488 (+ 5491us) server_negotiation.cc:407] Connection header received
0809 08:02:44.141022 (+ 4534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.141025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.141088 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.141138 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.142050 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.142814 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.143909 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:44.144243 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:44.144345 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:44.145876 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 08:02:44.145883 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 08:02:44.145886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 08:02:44.145914 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 08:02:44.147449 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.147918 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.147921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.147923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.148002 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 08:02:44.148291 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 08:02:44.148294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 08:02:44.148296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 08:02:44.148501 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 08:02:44.148602 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:44.148919 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 08:02:44.149051 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 08:02:44.161945 32703 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [term 1 FOLLOWER]: Refusing update from remote peer 049da26234644d57bd04c00772e50622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:44.161945 314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [term 1 FOLLOWER]: Refusing update from remote peer 049da26234644d57bd04c00772e50622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 08:02:44.162621 380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:44.166667 380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 08:02:44.169762 348 sys_catalog.cc:455] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049da26234644d57bd04c00772e50622. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.169865 348 sys_catalog.cc:458] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.171448 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049da26234644d57bd04c00772e50622. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.171556 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.177350 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.177466 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:44.177623 403 mvcc.cc:205] Tried to move back new op lower bound from 7316531462799683584 to 7316531462671888384. Current Snapshot: MvccSnapshot[applied={T|T < 7316531462799683584}]
I20260809 08:02:44.178761 348 sys_catalog.cc:455] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.178864 348 sys_catalog.cc:458] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.181226 405 mvcc.cc:205] Tried to move back new op lower bound from 7316531462799683584 to 7316531462671888384. Current Snapshot: MvccSnapshot[applied={T|T < 7316531462799683584}]
I20260809 08:02:44.183277 392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.183410 392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622 [sys.catalog]: This master's current role is: LEADER
I20260809 08:02:44.183815 400 catalog_manager.cc:1347] Generated new cluster ID: 3e4f23ce039a422ead3faf6bf7193cec
I20260809 08:02:44.183873 400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 08:02:44.184384 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "049da26234644d57bd04c00772e50622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049da26234644d57bd04c00772e50622" member_type: VOTER last_known_addr { host: "127.8.51.126" port: 43059 } } peers { permanent_uuid: "7ed3ebe0946445919840a2e223f09ff9" member_type: VOTER last_known_addr { host: "127.8.51.125" port: 38797 } } peers { permanent_uuid: "c738dcc867c4443d8162099ab9cf4892" member_type: VOTER last_known_addr { host: "127.8.51.124" port: 39671 } } }
I20260809 08:02:44.184487 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 08:02:44.184901 404 mvcc.cc:205] Tried to move back new op lower bound from 7316531462799683584 to 7316531462671888384. Current Snapshot: MvccSnapshot[applied={T|T < 7316531462799683584}]
I20260809 08:02:44.203012 400 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 08:02:44.204164 400 catalog_manager.cc:1504] Loading token signing keys...
I20260809 08:02:44.218299 400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 049da26234644d57bd04c00772e50622: Generated new TSK 0
I20260809 08:02:44.219061 400 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 08:02:44.248656 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.246098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.8.51.126:43059)
0809 08:02:44.246227 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.246231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.247519 (+ 1288us) server_negotiation.cc:407] Connection header received
0809 08:02:44.247740 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.247743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.247792 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.247843 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.248475 (+ 632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53548: BlockingRecv error: recv got EOF from 127.0.0.1:53548 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 08:02:44.250057 346 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.246925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.8.51.124:39671)
0809 08:02:44.247035 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.247039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.249129 (+ 2090us) server_negotiation.cc:407] Connection header received
0809 08:02:44.249291 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.249294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.249343 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.249391 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.249950 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53274: BlockingRecv error: recv got EOF from 127.0.0.1:53274 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 08:02:44.251959 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.250710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53374 (local address 127.8.51.125:38797)
0809 08:02:44.250819 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.250825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.251052 (+ 227us) server_negotiation.cc:407] Connection header received
0809 08:02:44.251228 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.251231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.251285 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.251338 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.251850 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53374: BlockingRecv error: recv got EOF from 127.0.0.1:53374 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 08:02:44.259251 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.257964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53380 (local address 127.8.51.125:38797)
0809 08:02:44.258074 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.258078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.258280 (+ 202us) server_negotiation.cc:407] Connection header received
0809 08:02:44.258493 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.258496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.258581 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.258636 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.259145 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53380: BlockingRecv error: recv got EOF from 127.0.0.1:53380 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 08:02:44.264425 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.262964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.8.51.125:38797)
0809 08:02:44.263063 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.263067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.263550 (+ 483us) server_negotiation.cc:407] Connection header received
0809 08:02:44.263754 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.263758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.263806 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.263858 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.264331 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53396: BlockingRecv error: recv got EOF from 127.0.0.1:53396 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 08:02:44.270068 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.268581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53402 (local address 127.8.51.125:38797)
0809 08:02:44.268674 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.268677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.269147 (+ 470us) server_negotiation.cc:407] Connection header received
0809 08:02:44.269328 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.269332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.269376 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.269426 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.269977 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53402: BlockingRecv error: recv got EOF from 127.0.0.1:53402 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 08:02:44.277971 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.276393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53406 (local address 127.8.51.125:38797)
0809 08:02:44.276526 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.276530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.277016 (+ 486us) server_negotiation.cc:407] Connection header received
0809 08:02:44.277227 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.277230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.277280 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.277334 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.277877 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53406: BlockingRecv error: recv got EOF from 127.0.0.1:53406 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 08:02:44.289857 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.288191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.8.51.125:38797)
0809 08:02:44.288290 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.288294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.288841 (+ 547us) server_negotiation.cc:407] Connection header received
0809 08:02:44.289050 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.289054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.289110 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.289169 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.289749 (+ 580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53414: BlockingRecv error: recv got EOF from 127.0.0.1:53414 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 08:02:44.310101 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.308447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.8.51.125:38797)
0809 08:02:44.308563 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.308580 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.309098 (+ 518us) server_negotiation.cc:407] Connection header received
0809 08:02:44.309299 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.309302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.309351 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.309399 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.309991 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53424: BlockingRecv error: recv got EOF from 127.0.0.1:53424 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 08:02:44.345970 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.344637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53438 (local address 127.8.51.125:38797)
0809 08:02:44.344779 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.344784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.345014 (+ 230us) server_negotiation.cc:407] Connection header received
0809 08:02:44.345141 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.345144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.345226 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.345374 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.345866 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53438: BlockingRecv error: recv got EOF from 127.0.0.1:53438 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 08:02:44.413594 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.412226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.8.51.125:38797)
0809 08:02:44.412363 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.412367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.412552 (+ 185us) server_negotiation.cc:407] Connection header received
0809 08:02:44.412678 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.412681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.412730 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.412815 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.413398 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53450: BlockingRecv error: recv got EOF from 127.0.0.1:53450 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 08:02:44.544956 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.543660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53464 (local address 127.8.51.125:38797)
0809 08:02:44.543826 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.543848 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.544003 (+ 155us) server_negotiation.cc:407] Connection header received
0809 08:02:44.544184 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.544187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.544245 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.544340 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.544825 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53464: BlockingRecv error: recv got EOF from 127.0.0.1:53464 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 08:02:44.804240 32736 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 08:02:44.803153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53470 (local address 127.8.51.125:38797)
0809 08:02:44.803301 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:44.803305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:44.803325 (+ 20us) server_negotiation.cc:407] Connection header received
0809 08:02:44.803472 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:44.803488 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:44.803534 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:44.803607 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 08:02:44.804107 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53470: BlockingRecv error: recv got EOF from 127.0.0.1:53470 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 08:02:45.103163 361 catalog_manager.cc:1259] Loaded cluster ID: 3e4f23ce039a422ead3faf6bf7193cec
I20260809 08:02:45.103248 361 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: loading cluster ID for follower catalog manager: success
I20260809 08:02:45.105110 361 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: acquiring CA information for follower catalog manager: success
I20260809 08:02:45.106515 361 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c738dcc867c4443d8162099ab9cf4892: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:02:45.111183 378 catalog_manager.cc:1259] Loaded cluster ID: 3e4f23ce039a422ead3faf6bf7193cec
I20260809 08:02:45.111243 378 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: loading cluster ID for follower catalog manager: success
I20260809 08:02:45.112721 378 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: acquiring CA information for follower catalog manager: success
I20260809 08:02:45.113791 378 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7ed3ebe0946445919840a2e223f09ff9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 08:02:45.324561 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:45.318969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53472 (local address 127.8.51.125:38797)
0809 08:02:45.319240 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:45.319245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:45.319387 (+ 142us) server_negotiation.cc:407] Connection header received
0809 08:02:45.319529 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:45.319532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:45.319717 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:45.319909 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:45.320290 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.321169 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.322683 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.323052 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.323154 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:45.323598 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:45.324177 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:45.324305 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:45.324345 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 08:02:45.324402 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":107,"threads_started":1}
I20260809 08:02:45.332612 483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:45.327574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.8.51.124:39671)
0809 08:02:45.327810 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:45.327813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:45.327827 (+ 14us) server_negotiation.cc:407] Connection header received
0809 08:02:45.328031 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:45.328035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:45.328212 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:45.328339 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:45.328595 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.329494 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.330747 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.331148 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.331281 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:45.331584 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:45.332150 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:45.332289 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:45.332355 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 08:02:45.332420 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260809 08:02:45.339534 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:45.335521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.8.51.125:38797)
0809 08:02:45.335630 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:45.335637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:45.335881 (+ 244us) server_negotiation.cc:407] Connection header received
0809 08:02:45.336055 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:45.336058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:45.336106 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:45.336172 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:45.336508 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.337224 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.338343 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.338634 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.338699 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:45.339099 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:45.339167 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:45.339211 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:45.339386 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 08:02:45.339429 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 08:02:45.339545 483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:45.335637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.8.51.124:39671)
0809 08:02:45.335748 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:45.335751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:45.336179 (+ 428us) server_negotiation.cc:407] Connection header received
0809 08:02:45.336356 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:45.336360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:45.336404 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:45.336445 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:45.336789 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.337414 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.338429 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.338724 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.338790 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:45.339134 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:45.339193 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:45.339236 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:45.339388 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 08:02:45.339429 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 08:02:45.340986 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 08:02:45.336049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.8.51.126:43059)
0809 08:02:45.336314 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 08:02:45.336318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 08:02:45.336368 (+ 50us) server_negotiation.cc:407] Connection header received
0809 08:02:45.336508 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 08:02:45.336511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 08:02:45.336682 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 08:02:45.336801 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 08:02:45.337208 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.338066 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.339364 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 08:02:45.339680 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 08:02:45.339782 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 08:02:45.340235 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 08:02:45.340507 (+ 272us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 08:02:45.340592 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 08:02:45.340674 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 08:02:45.340853 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":81,"threads_started":1}
I20260809 08:02:45.343627 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32583
I20260809 08:02:45.351732 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32660
I20260809 08:02:45.358530 8397 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzQyOdB/build/debug/bin/kudu with pid 32738
2026-08-09T08:02:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3069 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6193 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (283352 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST